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FOREWORD 


This report was prepared for the National Aeronautics and Space 
Administration by Calspan Corporation, Buffalo, New York, in partial fulfill- 
ment of USAF Contract No. F3361S-79-C-3618. This report describes an in-flight 
investigate i of the effects of pilot-induced oscillation filters on the long- 
itudinal flying qualities of fighter aircraft during the landing task. 

The in-flight program reported herein was performed by the Flight 
Research Department of Calspan under sponsorship of the NASA/Dryden Flight 
Research Center, Edwards, California, working through a Calspan contract with 
the Flight Dynamics Laboratory of the Air Force Wright Aeronautical Labora- 
tory, Wright-Patterson Air Force Base, Ohio. This work was part of Project 
6645-F, NT-33, Task 9 and utilized the USAF/FDL NT-33 aircraft, modified and 
operated by Calspan. Mr. Jack Barry is the program manager for FDL; his 
assistance deserves special acknowledgement. 

Completion of this program was dependent upon the contributions of 
many individuals from NASA/DFRC and Calspan. Mr. Donald Berry of NASA/DFRC 
was, to a large extent, primarily responsible for creating this program; his 
leadership and technical inputs were appreciated. The technical assistance of 
Messrs. Bruce Powers and James Stewart, NASA/DFRC is also gratefully acknow- 
ledged. Finally, thi3 program could not have been performed without the dili- 
gent work put forth by the NASA Program Manager, Ms. Mary Shafer; her work 
warrants special recognition and thanks. 

The work of the NASA/DFRC evaluation pilots, Mr. Thomas McMurtry and 
Mr. Michael Swann, deserves special acknowledgement particularly in light 
of the concentrated flight schedule and demanding flight tasks; their efforts 
were vital to successful program completion. 

This report represents the combined efforts of many individuals of 
the Flight Research Department. The project engineer was Mr. Randall E. 

Bailey, assisted by the NT-33 Program Manager, Mr. Rogers E. Smith, who also 
served as safety pilot. The efforts of Messrs. Ronald Huber and Bemie Eulrich 
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were instrumental in the successful integration of the NT-33 digital flight 
control capability; the work of Mr. Clarence Mesiah also deserves recogni- 
tion for developing the necessary digital control software. The contribu- 
tions of the following individuals are also gratefully acknowledged: 

Messrs. Mark Bergum and John ttabala — Electronic Design and Main- 
tenance. 

Messrs. A1 Schwartz, Mike Sears, and Bill Palmer - Aircraft Main- 
tenance. 

Mr. Michael Parrag — Calibration Flying. 

Mr. Charles Berthe - Safety Pilot (in relief of Rogers Smith). 

Finally, the excellent work of Ms. Chris Turpin and Ms. Janet 
Cornell in preparation of this report deserves very special recognition. 
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Section 1 
INTRODUCTION 

State-of-the-art aircraft designs, from fighters to supersonic cruise 
transports, are relying predominantly on digital flight control. The control 
system is used in these applications to augment the aerodynamics of the vehicle 
for maximum performance as well as compensate for stability and control defi- 
cienciesr Unfortunately, the most recent examples of aircraft employing this 
technology have exhibited poor flying qualities and pilot-induced oscillation 
tendencies during prototype flight test. 

The flying qualities problems experienced by highly augmented air- 
craft have been the subject of numerous experiments and research (for example. 
References 1-4). This work has been fundamental in generating data on aug- 
mented aircraft flying qualities for subsequent development of appropriate 
design criteria. Further, these studies (most notably. References 2 and 4) 
and recent experiences in prototype flight testing have shown that the flying 
qualities of augmented aircraft are highly dependent upon the task and its 
associated piloting control requirements. The flying qualities deficiencies 
of augmented aircraft have been characterized as a "cliff" because the aircraft 
exhibits dramatic changes in flying qualities as pilot compensation increases 
for tasks which require precise control of aircraft attitude and position. 

A classical illustration of this behavior is the approach and landing task. 

In this case, benign flying qualities on approach have been witnessed to 
deteriorate in the flare near touchdown into full blown, pilot-ini need oscil- 
lations (PIO) . 

The modern flight control system, dearly, must be designed with 
close regard to the available research and data to attain the potential af- 
forded digital flight control. However, real wcrld applications of this tech- 
nology may be constrained uy cost and design tradeoffs. These constraints 
may limit the design potential by imposing, for example, low actuator rote 
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limits or insufficient control authority. Indirect solutions may be desirable 
or necessary to compensate for less than ideal flying qualities. 

Adaptive filtering of pilot control inputs represents a potential 
indirect solution to improve flying qualities. The adaptive filter or Pilot- 
induced Oscillation Suppression (PIOS) filter is a digital algorithm which 
adjusts the pilot's available command to the appropriate control surface as a 
function of the frequency and amplitude of his input. The filter can poten- 
tially suppress pi loi- induced oscillations (PIO's) and prevent actuator rate lim- 
iting. Actuator rate limiting can, in itself, be a major cause of PIO's and 
in combination with other flight control system deficiencies, such as excessive 
time delay, can lead to serious PIO problems. When the filter operates in its 
ideal sense is a PIO' suppressor, complete control of the aircraft is retained 
until the pilot control inputs approach those which are "known" to induce 
oscillations. When this condition occurs, the filter reduces the pilot's com- 
mand gain to the control surfaces, thus minimizing the resultant aircraft motion. 
The filter, in essence, opens the pilot/vehicle control loop to suppress the 
PIO. 


This report describes an in-flight investigation of adaptive filtering 
for the suppression of pilot-induced oscillations using the variable stability 
USAF/FDL NT-33A aircraft, modified and operated by Calspan. The investigation 
was designed to test different PIOS filters and determine their effects on 
fighter aircraft flying qualities in the visual approach and landing task 
(Flight Phase Category C). This program was limited to the evaluation of 
longitudinal flying qualities, however, the same technique of PIOS filtering 
can be applied to the lateral control axes. The evaluation task included air- 
craft flare ar.d actual touchdowns. 

This evaluation task was chosen primarily because precise, closed- 
loop piloting control of the aircraft is required for adequate task perfor- 
mance. As a result, the task is suitable for the evaluation of augmented air- 
craft flying qualities and pilot-induced oscillations. The task provides an 
excellent setting for proper evaluation of PIOS filtering. 
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The objectives of this flight program were to: 

• Examine adaptive filtering (PIOS filters) of pilot inputs for 
the suppression of pilot-induced oscillations. 

• Discern the effects of PIOS filters on the longitudinal flying 
qualities of fighter aircraft during the visual approach and 
landing task. 

This report is essentially a data report in that no detailed analysis 
of the results have been made. Nevertheless, pertinent observations are in- 
cluded to add insight into the program where appropriate. The report is organ- 
ized as follows: Section 2 contains the experiment design, objectives, and 

the experiment configuration characteristics; the conduct of the experiment, 
including descriptions of the evaluation procedures and tasks, is given in 
Section 3; Section 4 includes the experiment results and observations; finally, 
concluding remarks and recommendations based on this work are listed in Sec- 
tions 5 and 6. Detailed background material and data are included in a series 
of appendices. 
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Section 2 
EXPERIMENT DESIGN 

This in-flight investigation was designed to satisfy the program 
objectives as completely as possible and to generate a coherent data base for 
subsequent analysis. Again, the program objectives were to: 

• Examine adaptive filtering (PIOS filters) of pilot control 
inputs for the suppression of pilot-induced oscillations. 

• Discern the effects of PIOS filters on the longitudinal flying 
qualities of fighter aircraft during the approach and landing 
task. 

The experiment was performed using the variable stability NT-33, 
in-flight simulator. Details of the simulation mechanization, including cali- 
bration and implementation of the configuration characteristics, are given in 
Appendix III. A more thorough documentation of the NT-33A and its operation 
is provided in Reference 5. 

This experiment was an investigation of longitudinal landing flying 
qualities; hence, the roll and yaw control systems were tailored to produce 
unobtrusive, Level 1 flying qualities. Evidence that this goal was achieved 
is found by the absence of adverse pilot commentary regarding the simulated 
aircraft's lateral-directional characteristics. These characteristics are 
documented in Appendix IV. 

The following sections outline the configuration characteristics and 
experiment variables. The sections are organized to present, cumulatively, 
a complete dynamic description of the simulated longitudinal control system for 
each experiment configuration. 
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2.1 


EXPERIMENT VARIABLES 


Two primary experiment variables were clearly dictated for satisfac- 
tion of the experiment objectives: fighter aircraft longitudinal dynamics and 

RIOS filter designs. Four aircraft configurations, possessing different fighter 
flying qualities, were selected as the control group for the examination of 
PIOS filtering. Because this program was indirectly prompted by the flying 
qualities deficiencies experienced by highly augmented aircraft, the aircraft 
configurations were chosen to emulate both proper and improper augmented air- 
craft control system designs. In this manner, the examination of adaptive fil- 
tering (PIOS filters) was performed using aircraft configurations with various 
levels of flying qualities and PIO tendencies which potentially arise from 
digital flight control system designs. 

The pitch control system of the experiment configurations is shown 
in Figure 2-1. The basic aerodynamic characteristics of the NT-33 aircraft 
were augmented by appropriate feedbacks to produce satisfactory. Level 1 pitch 
dynamics (Appendix III). This configuration represented the baseline aug- 
mented aircraft. Three additional aircraft configurations (completing the 
experiment control group) were developed by adding either digital time delay 
or lag prefiltering. These parameters replicate the degrading effects of 
increased computational time delay and cascaded filters on the longitudinal 
flying qualities of an otherwise Level 1, augmented airplane. Thus, four 
augmented aircraft configurations were used to establish the experiment control 
group of fighter longitudinal flying qualities for the evaluation of PIOS 
filtering. 


2.2 AIRCRAFT CONFIGURATIONS 

2.2.1 Baseline Dynamics 

The pitch dynamics for the baseline augmented aircraft were identical 
to LAHOS Configuration 2-1 from the Landing Approach Higher Order Systems 
(LAHOS) program (Reference 2) . This configuration was selected because its 
characteristics yielded excellent approach and landing flying qualities. The 
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configuration's constant speed pitch transfer function for the landing flare 
was: 


» 

6 es 8 7 -+2(0.6)(2.3 )b+2.Z 2 

where t = 1.4 sea 

Q 2 

n /a = 4.6 g/rad 
z 

and V *120 KIAS 

2.2.2 Other Aircraft Configuration Characteristics 

With the augmented aircraft's short period pitch dynamics established, 
the remaining aircraft configurations were created by adding incremental values 
of time delay or a first-order lag prefilter to the pitch control system. The 
augmented aircraft without additional time delay or lag filtering was the "base- 
line" aircraft configuration (Configuration TO) . 

The amount of time delay or lag filtering required to degrade the baseline 
configuration and develop a PlO-prone aircraft was predicted using previous 
research data (Reference 2, for example). The first evaluation flight was 
used to finalize the configuration matrix. The objective was to create two 
configurations which had definite PIO tendencies but were not ridiculous to 
the extent that control was impossible or safety severely compromised. It 
was also desirable that the one configuration have flying qualities which were 
in between the baseline and two PlO-prone aircraft. These three configurations, 
created by adding control system dynamics to the baseline configuration, are 
described below. 

A 2 radian per second, first order lag prefilter was added to form 
one configuration (Configuration FI) . This configuration is nearly identi- 
cal to LAHOS Configuration 2-4 which was evaluated in LAHOS as having very sig- 
nificant PIO tendencies (Reference 2). The lag prefilter produced a low fre- 
quency PIO due to a sluggish initial pitch response. 
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Another PlO-pronc aircraft was developed by adding 120 milliseconds 
of pure time delay to the baseline augmented aircraft. This configuration (Con- 
figuration T2J was very representative of a digitally-controlled aircraft whose 
flying qualities arc compromised by time delay. The characteristic PIO fre- 
quency of this configuration should provide good contrast with Configuration FI 
and therefore test the ability of the adaptive filters for the suppression of 
different types of PIO. 

The last configuration (Configuration Tl) was chosen to possess only 
mild PIO tendencies, if any. This configuration was established by adding 70 
milliseconds of transport delay to the baseline augmented aircraft control sys- 

t ' '.i . 


The four configurations and their identifiers are summarized in Fig- 
ure 2-2. Additional control system dynamics and characteristics are common to 
all the configurations as shown in Figure 2-1. These are documented in Section 
2.4 since they are necessary to derive the complete dynamic description of the 
configurations. It is important to note that when transport time delay is intro- 
duced into the experiment flight control system, two analog filters are also in- 
cluded (Figure 2-2). The baseline configuration (Configuration TO), therefore, 
differs from Configuration Tl and T2 by the added digital time delay (70 and 
120 msec, respectively) and the two filters. These filters are a necessary part 
of the NT-33's time delay network and could not be excluded. The filters are 
detailed fully in Section 2.4. Any analysis of the data and results from this 
program must include the filters as well as the added digital delay for correct 
interpretation . 

2.3 PIOS FILTER CONFIGURATIONS 


The pilot-induced oscillation suppression (PIOS) filter configurations 
were selected, in part, based on the results of work investigating PIOS filters 
which preceded this program (References 6 and 7) . The number of experiment 
parameters was reduced to a manageable size by using the results of References 
6 and " together with unpublished data from NASA/DFRC tests of PIOS filters 
during simulated aerial refueling tests. 


8 



ORlGifl. 

OF POOR QUALViY 






* See Section 2.4 


Figure 2-2: AUGMENTED AIRCRAFT CONFIGURATION 
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Two types of adaptive filters were tested in this program. Primary 
emphasis was placed on examining adaptive filters which act as a function of 
;tick position (<i ) (Figure 2-3). A brief look was also taken at adaptive 

filtering of pilot control inputs based on a weighted stick rate function 
( Figure 2-4) . 

Each of the two filtering algorithms calculate a forcing function, W. 
This forcing function is the measure of pilot control activity from which the 
amount of pilot control input attenuation is determined according to the gain 
attenuation schedule. The parameter, W, represents an estimated frequency of 
the pitch stick position movement for the position PIOS filter and an exponen- 
tially-weighted, time-rate of change of stick position for the rate PIOS filter. 

This experiment was designed to investigate primarily the effects of 
PIOS filters on longitudinal flying qualities in terms of the degree to which 
the PIOS filters attenuate pilot control commands. To achieve this objective, 
the algorithms to compute the forcing functions for each of the filters were 
nearly identical to those investigated previously and held constant for this 
program. The gain attenuation schedule, therefore, was the primary filter var- 
iable. For each PIOS filter-type (position or rate PIOS filter), different 
gain attenuation schedules were examined. The schedules determine the level of 
input suppression through the factor XX and the nonlinear shaping gradient. For 
example, the calculation of V for all of the position PIOS filters with a given 
input was identical, but the level of input suppression (XX) for each configura- 
tion varied according to its gain attenuation schedule (Figure 2-S) . Although 
the algorithms to calculate the forcing function, W, were not varied in this 
program, future work should investigate this area in an experimental fashion. 

Ihe results of Reference 7 suggest that the calculation of W has a significant 
influence on the operation of the PIOS filters and, hence, flying qualities. 

The limited scope of this program, however, precluded examination of different 
algorithms to calculate the suppression filter forcing functions. 

The gain attenuation schedule for each suppressor was uniquely de- 
scribed by a slope (.V) and breakpoint (WMIN) with the minimum value of 
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CONSTANT 

NOMINAL VALUE 

a 

0.65 

b 

1.0 
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6.0 
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3.0 
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0.1 

Deadband 

0.1 


Figure 2-3: STICK POSITION PIOS FILTER 
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Figure 2-5: EXPERIMENT MECHANIZATION 
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■ . equal to 0.1 (XfC-lIN ) . Seven position PIOS filter configurations wei-e created 
by different combinations of attenuation slopes and breakpoints. Four rate 
PIOS filter configurations were formed in the same manner. These configura- 
tions and their identifiers are given in Table I. 


The PIOS filters were implemented as digital algorithms in the NT-33's 
digital flight control computer with stick position as the only input (Appen- 
dix III). Stick position was, in all cases, passed through a deadband of 0.1 
inches. For evaluations of the aircraft configurations without filtering, the 
nonlinear gradient was mechanized with XK equal to 1.0; hence, the effect of 
PIOS filtering was isolated. 

2.4 ADDITIONAL CONFIGURATION CHARACTERISTICS 


The experiment variables (aircraft and PIOS filter configurations) 
have been described in the previous sections. This section completes the 
documentation of the nominal pitch dynamics and control system elements common 
to each configuration. Description of these elements completes the longitudinal 
transfer function description of the evaluated configurations. 

2.4.1 Approach Pitch Dynamics 

The augmented aircraft's pitch dynam-cs have been given for the landing 
flare in Section 2.2. Extrapolation of the landing flare dynamics are required 
to extract the approach pitch dynamics. Since the augmented aircraft was flown 
on a given flight at different fuel loads and thus, gross weight, the approach 
airspeed was scheduled with fuel remaining so angle of attack was held constant 
for each approach. This process effectively keeps the important dynamic char- 
acteristics constant throughout the flight. For the approach task, the constant 
speed pitch dynamics were approximately: 


e 

V 


a 2 +Z(0. 6) (2. 6) a+2.6 2 
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TABLE I 

PIOS FILTER CONFIGURATIONS 

• GAIN ATTENUATION SCHEDULE: 

1.0 for W < WHIN 

XX - 1+(W-WMIN)CW for UMIN 4 (0.9/CW) + WHIN 

0.1 for W > ( 0.9/CW- > + WIN 

• POSITION PIOS FILTER CONFIGURATIONS: 



• RATE PIOS FILTER CONFIGURATIONS: 



1 

IS 


OMGIMAL PMK ® 

OF POOR QUALITY 


where t * 2.25 86c? 

®2 


n_/a *5.5 g/rad 

and ^ » 235 mS 


2.4.2 Long Term Pitch Characteristics 


The augmented aircraft configuration's phugoid, or long term, pitch 
response characteristics are those of the NT-33A, modified slightly by the long- 
itudinal feedbacks used to achieve the desired s> rt period dynamics. For 
this experiment, the following values pertain: 


u , * 0.1? rad/aec 

ph 

Vi ' 11 

X. « 12 aec 

e i 


All approaches were flown on the front side of the power-required 
versus velocity curve. 


2.4.3 Pitch Command Gain 


The pitch command gain, M* > , was selected according to pilot commen- 

88 

tary at the beginning of evaluation flying to provide satisfactory stick forces 
throughout the approach, landing and subsequent takeoff. After evaluation flying 
■_egan, the pitch command gain was fixed for all evaluations, including PIOS fil- 
ter evaluations. There was, however, one evaluation which was flown with 1/2 the 

nominal value of , (see Section 4.2). For the landing flare, the nominal 
88 

value of pitch command gain was: 

M. , *0,4? rad/aac 2 -inch 

6 «a 


In the approach flight phase, M increased by approximately 20\, 

ea 
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2.4.4 


Feel System Characteristics 


r 



A center stick controller was implemented for aircraft pitch and roll 
control. The pitch center stick dimensions and travel are shown in Figure 2-6. 
The feel system characteristics for this controller were held fixed throughout 
the program and were chosen to be satisfactory and unobtrusive. Essentially, 
zero breakout or f fiction forces were present. The pitch feel system charac- 
teristics were: 



0.225 


(a\2 2(0. 6)9 

\26) + 26 


1 


(inohea/lbe) 


These feel system characteristics are identical to those flown in 
the LAHOS program (Reference 2). 


2.4.5 Digital Computer 

As noted earlier, the digital flight control capabilities of the 
NT-33 aircraft were utilized in this program for implementation of the PIOS 
filters. The computer was also used for evaluations without PIOS filtering 
to mechanize the nonlinear gradient and deadband, and include the inherent 
digital time delay of the computer in each configuration. The computer update 
rate was a constant 50 cycles per second resulting in a nominal 20 milli- 
seconds of time delay. In addition, an 11 Hertz, second order filter with a 
damping ratio of 0.7 was placed on the output of the computer for signal 
smoothing. 

2.4.6 Time Delay Filters 

Time delay was added to the baseline configuration (Configuration TO) 
to create configurations T1 and T2. 70 msec and 120 msec of pure (transport) 

time delay were introduced in the experiment flight control system to simulate 
configurations T1 and T2. However, two analog filters are also included with 
the addition of this digital delay. The filters are a necessary part of the 
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time delay network in the NT-33's variable stability system. This network is 
described fully in Appendix III. For correct interpretation of the data and 
results, these filters must be included in any description of the experiment 
flight control system when appropriate. The filters are third-order Butterworth 
filters with dynamics as follows: 


INPUT FILTER: 


OUTPUT FILTER: 


77 , 7 \ r a* " IIMT Z7 

( 314 1 ) XJT? 1 314 i 1 _ 


(L- + i)f®l 

\50 J150 2 


. 2(0.5) 


] 


2.4.7 Actuator Dynamics 

The NT-23A pitch actuator dynamics were constant for all configura- 
tions. Its dynamics are described by a second-order transfer function with: 

a : e = 75 rad/ sea 

C = 0.7 

e 

In addition, signals to the actuator are passed through a first-order 
lag prefilter which has a break frequency of 200 radians per second. 

2.5 CONFIGURATION IDENTIFIERS 

The longitudinal augmented aircraft and PIOS filter configuration 
characteristics have been described in this section. Evaluation configura- 
tions were created by combinations of augmented aircraft and PIOS filter con- 
figurations. Four augmented aircraft configurations were created by adding 
different control system elements to the baseline pitch configuration. Those 
established the experiment control group of aircraft flying qualities. Seven 
position and four rate PIOS filter configurations were the primary experiment 
variables. 
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For the remainder of this report, the configuration identifiers are 
used to describe an evaluation configuration and, therefore, the experiment 
variables it represents. The variables in the longitudinal control system are 
the control system dynamics, PIOS filter-type, and gain attenuation schedule. 

The configuration ingredients are summarized in Figure 2-2 and Table I. For 
example. Configuration T2(A-6) is 

T2: Augmented aircraft configuration with 120 msec transport time 

delay added to the baseline configuration, and 

A-6: Position PIOS filter with gain attenuation schedule deter- 

mined by a slope (CW) of -1.0 and breakpoint (WMIN) of 0.0. 

The complete longitudinal transfer functions are obtained by combining 
the block diagram of the individual control system elements as they have been 
presented in this section. The lateral-directional aircraft characteristics 
are summarized in Appendix IV. 
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Section 3 

CONDUCT OF THE EXPERIMENT 

3.1 USAF/FDL/CALSPAN VARIABLE STABILITY NT-33 AIRCRAFT 

The simulated longitudinal and lateral configurations were mechanized 
using the USAF/FDL variable stability NT-33 aircraft operated by Calspan (Fig- 
ure 3-1). A complete description of the aircraft's operation is contained in 
Reference 5. Details of the simulation mechanization, including the calibration 
procedures used in this program, are given in Appendix III. In the variable sta- 
bility aircraft, the evaluation pilot occupies the front cockpit, while the sys- 
tem operator, who occupies the reai cockpit, acts as safety pilot. The sta- 
bility and control characteristics about all three axes can be varied in flight b) 
changing the settings of the fly-by-wire system gain controls in the rear cockpit. 
The baseline augmented aircraft configuration was set up by the safety pilot 
using the appropriate calibrated system gains. If required, control system 
time delay and first order lag filtering were selectable using special switches 
in the rear cockpit. The PIOS filter configurations were engaged by the safety 
pilot through the Mode Control Unit of the digital computer from the rear cockpit 
(Appendix III). During a given flight, a maximum of sixteen PIOS configura- 
tions were accessible. 

It is important to note that the evaluation pilot cannot feel the 
NT-33 control surface motions caused by the demands of the fly-by-wire control 
system in reproducing the desired configuration response characteristics. 

3.2 SIMULATION SITUATION 

Since inclusion of wind and turbulence as controlled parameters was 
beyond the scope of this experiment, the flights were flown in a variety of 
weather environments under visual flight conditions. All flights were operated 
in conditions which could be considered typical of normal fighter operations. 
Evaluation flying was performed at Dryden Flight Research Center, California. 
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Figure 3-1 USAF/CALSPAN VARIABLE STABILITY NT-33 AIRCRAFT 
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For this program, the wind and turbulence were both generally light; 
however, on tv.j flights (Flights 2693 and 2694), the turbulence and wind were 
significant factors. These conditions were ideal for comparison of configuration 
evaluations in turbulent as opposed to benign environments. The pilots were 
asked on each flight to evaluate the aircraft in the conditions of the day and 
comment, if desired, on the effect that wind and turbulence had on the evalua- 
tion or task. 

3.3 EVALUATION PROCEDURE 

The configurations were evaluated in a generally random order. The 
evaluation pilots had no knowledge of the configurations nor did they know if 
the configurations contained a PIOS filter. Yet, an important consideration 
in the conduct of this program was the "calibration" of the evaluation pilots. 

Because the majority of the configurations had significant PIO ten- 
dencies and many possessed marginal controllability, biasing of the pilot rat- 
ings and evaluations was a real concern; that is, the evaluations may have 
become a comparison of poor flying qualities. To avoid this situation, a 
conscious effort was made during evaluation flying to have each pilot eval- 
uate at least one "good" flying qualities configuration per flight* In addi- 
tion, one touch-and-go was flown at the start of the evaluation flight with 
the baseline augmented aircraft (Configuration TO). These procedures recali- 
brated the pilot's sense of good aircraft flying qualities and ensured that 
the evaluations were more an absolute, rather than relative, measure of fly- 
ing qualities. Biasing of the evaluations was, therefore, eliminated. 

Each evaluation took an average of 20 minutes to complete. After 
the initial touch-and-go with the baseline aircraft, the evaluations were con- 
ducted in the following manner: 

e The safety pilot implemented the evaluation configuration and 
engaged the variable stability system. 
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• Evaluation pilot was given control of the aircraft on downwind 
with gear down, flaps 30°, and speed brakes closed at the approach 
airspeed appropriate for the fuel remaining. 

• Pitch calibration records consisting of a pitch step and stick 
raps were taken for subsequent analysis. 

• Evaluation pilot performed the evaluation following the task 
outline (Section 3.4). 

a After completing the task, the safety pilot took control of the 
aircraft while the evaluation pilot assigned a Cooper-Harper 
pilot rating (PR) and pilot-induced oscillation classification/ 
rating (PIOR) using the appropriate scales (Figures 3-2 and 3-3) . 

• Evaluation pilot made recorded comments in reference to the com- 
ment card (Figure 3-4) and finally reviewed the pilot rating and 
made changes, if needed. 

3.4 EVALUATION TASK 


The evaluation task has been shown in numerous flying qualities ex- 
periments (for example, references 2 and 4) to be crucial to the proper eval- 
uation of aircraft flying qualities. For this reason, the details of the task 
performed during each evaluation are summarized below. 

• Two visual approaches to landing and takeoff (touc* and-go's) 

were made for each evaluation. At discretion of evaluation pilot, 
a third touch-and-go would be performed. 

e First approach was flown with a small lateral offset (<\,75 ft) 
aligned to the edge of the painted runway outline (Figure 3-5). 
Sidestep maneuver to landing was initiated upon crossing start 
of paved runway at EDW Runway 22 (approximately 0.5 NM from run- 
way threshold) . 
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HANDLING QUALITIES RATING SCALE 
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AOCOUACY FOR UL1CTCO TASK OR 
RCOUMSO Odd RATION* 


CHARACTVRtdTtCS 


PI IIUNCS OH THE PILOT PILOT 

m s«l servo task or rroward oprratioh* rating 



Eacetient 

Pitot compensation not a factor for 

H*9Wy desirable 

desired performance 

Good 

Pilot compensation not a factor for 

NagiigiW# 4 '.(k irk in 

deseed performance 

Fur — So** ffMkfty 

Mirnmaf pitot compensation required for 

unpRauoi deficiencies 

dewed performance 


Mmor but annoying 

Oewtd performance requires moderate 

deficiency* 

pitot compensation 

Modarmety objectionable 

Adaquate performance requires 

deficiencies 

consider abte pitot compensation 

Very obiectionabte but 

Adaquate performance r*Qu*** satensrve 

toierabie deficiencies 

pitot compensation 


Major deficiencies 


Adequate p erformance not attainable with 
memmum tolerable pilot compensation 
ComroHabiMy not m qu es ti o n 


h 

Major deficiencies 

Considerable pilot compensation •* required 
for control 

J 

Major deficiencies 

Intense p«tot compensation is required to 
retem control 



H 

Major deficiencies 

Control writ be lost during seme portion of 
required operation 


a 
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DEFINITIONS FROM TN-D-5153 


COMPENSATION 

The measure of additional pilot effort 
and attention required to maintain a 
given level of performance in the face of 
deficient vehicle characteristics 

HANDLING QUALITIES 

Those qualities or characteristics of an 
aircraft that govern the ease and preci* 
sion with which a pilot is able to perform 
the tasks required in support of an air- 
craft role. 

MISSION 

The composite of pilot -vehicle functions 
that must be performed to fulfill opera- 
tional requirements. May be specified for 
a role, complete flight, flight phase, or 
flight subphase 


PERFORMANCE 

The precision of control with respect to 
aircraft movement that a pilot is able to 
-achieve in performing a task (Pilot- 
vehicle performance is a measure of 
handling performance. Pilot perform- 
ance is a measure of the manner or 
efficiency with which a pilot moves the 
principal controls in performing a task ) 

ROLE 

The function or purpose that defines the 
primary use of an aircraft. 

TASK 

The actual work assigned a pilot to be 
performed m completion of or as repre- 
sentative of a designated flight segment 


WORKLOAD 

The integrated physical and mental effort required 
to perform a specified piloting task 


Figure 3-2: COOPER-HARPER PILOT RATING SCALE 
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• Feel System Characteristics: 

- Forces/Displacements? 

• Pitch SensitivityT 

a Pitch Attitude Control: 

- Initial Response? 

- Final Response? 

- Predictability? 

e Pilot-in-the-Loop Aircraft Behavior: 

- Any PIO tendency, undesirable Motions? 

- Relative susceptibility to PIO, overshoot? 

- Any special piloting techniques/ compensation 
required? 

- Any differences: 

- snail vs. large inputs? 

- open vs. closed-loop control? 


• Task Performance: 

• Airspeed control? 

- Touchdown point accuracy? (within limits?) 

- Sink rate at touchdown? 

- Runway alignment? 

- Level of aggressiveness used to control touchdown 
point? 

- Task differences: Approach/ Landing/Takeoff? 

e Additional Factors: 

- Any influence on evaluation due to: 

- wind/ turbulence 

- lateral-directional characteristics 

• Sumary: 

- Any change in rating? 

Figure 3-4: PILOT COMMENT CARr 
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• Second approach was flown with a large lateral offset aligned 
to the edge of the runway pavement (~150 ft). Offset correc- 
tion wa3 initiated at same point for landing lin'sup. 

• Touchdown zone was 1,000 ft long starting at the runway thres- 
hold and aligned ±10 ft laterally of runway centerline. Touch- 
down aimpoint was 500 ft past the runway threshold for a ±500 ft 
spacing within the desired touchdown zone. 

e Approach airspeed was maintained at ±5 kts of appropriate air- 
speed with touchdown at approximately 120 KIAS. At a nominal 
gross weight, NT-33 approach speed was 135 KIAS. 

The importance of the task was continually stressed throughout the 
program. The pilots were instructed to treat each landing as a "must land" 
situation. In many cases, the nature of the configurations made touchdowns 
with any margin of safety difficult. However, each pilot approached the pro- 
gram knowing the importance of the task and stuck to it as closely as pos- 
sible. Each pilot was given the opportunity to comment on the task and de- 
scribe his ability to perform it. Knowing there was strict adherence to the 
task gives the analyst considerable insight into a configuration's flying qual- 
ities through the pilot comments. 

3.5 EXPERIMENT DATA 

The data from this program takes three forms: pilot ratings, pilot 

comments, and task periormance records. Pilot ratings and comment data are 
summarized briefly in Section 4. Each evaluation and corresponding pilot 
comments are summarized in Appendix I. Task performance records of selected 
configurations and landings are included in Appendix II. These records show 
the approach to landing following the lateral sidestep maneuver. Detailed 
analysis of the data was beyond the scope of this data report. 
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3.6 


EVALUATION PILOTS 


Three evaluation pilots produced the flying qualities data in this 
program. Pilots A and B evaluated the majority of the configurations. A brief 
overview of each pilot's previous experience pertaining to this flying quali- 
ties investigation is presented to aid the analyst in the review of their 
respective pilot comments. 

Pilot A: Thomas C. McMurtry, NASA/DFRC Test Pilot 

No previous evaluation pilot experience with PIOS filters; 
however, he did fly some evaluations on the effects of 
control system time delays on landing flying qualities 
using the NASA/DFRC F-8 DFBW aircraft. (Reference 4) . 

Pilot B: Michael R. Swann, NASA/DFRC Test Pilot 

Primary evaluation pilot during F-8 DFBW investigation 
of PIOS filtering during simulated aerial refueling task. 
He did not, however, participate as an evaluation pilot 
in the F-8 landing time delay study. 

Pilot C: Rogers E. Smith, Calspan Engineering Test Pilot 

No extensive PIOS filter evaluation flying experience. 
Pilot C was the safety pilot for both the LAHOS program 
and all NT-33/PIOS flights with Pilots A and B prior to 
his own evaluation flight. 
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Section 4 

EXPERIMENT RESULTS 


This section documents the results of this in-flight investigation 
and briefly discusses pertinent observations. Detailed analyses of the re- 
sults were not undertaken. 

4.1 FLIGHT PROGRAM SUfftiARY 

The data was gathered for this flight program during eight evalua- 
tion flights performed at Dryden Flight Research Center, California in June 1981. 
Forty evaluations of 27 configurations were made by the three project pilots. 
Twenty-one out of the total 27 configurations possessed PIOS filters* 


The breakdown of evaluations and configurations flown by each pilot 
is tabulated below: 



Flights 

Evaluations 

Configurations 

Pilot A: 

4 

20 

18 

B: 

3 

IS 

14 

C: 

1 

S 

5 


Ten overlapping evaluations were flown; that is, two pilots eval- 
uated the same configuration. These evaluations were for substantiation of 
the data base since they provide insight on each pilot's particular method of 
evaluation and the degree to which their evaluations concur. 

4.2 EXPERIMENT DATA 

The pilot rating data from this program is presented in Table II. 
This table summarizes the evaluated configurations and experiment parameters, 
the flight number, evaluation pilot, and pilot rating data. The complete 
configuration characteristics can be derived from the data of Section 2. 








































TABLE II (CONT'D) 
EXPERIMENT RESULTS SUKMARY 


CONFIGURATION 



FCS 

DYNAMICS 

PIOS FILTER 



IDENTIFIER 

FLIGHT NO. 

PILOT 

X D 

TYPE 

CW 

WMIN 

PR/SPR 

PI0R 

T2(E-7) 

2696 

A 


RATE 

- 0.25 

5.0 

8/9 

5 

T2 (E— 8) 

2693 

A 


RATE 

- 0.07S 

5.0 

8/5 

4 

. T2(F-8) 

2694 

B 


RATE 

- 0.07S 

10.0 

10/10 

6 

T3 

2686 

A 

0.16 


****** 


10/9 

5 

FI 

2686 

A 

— 2.0 

— 

— 

— 

7/8 

4 


2695 

B 





8/7 

5 


2697 

C 





7/6 

4 

Fl(A-l) 

2697 

C 


PSTN 

-10.0 

0.0 

8/6 

3 

FI (A- 2) 

2696 

A 


PSTN 

- 5.0 

0.0 

6/8 

1 


2696 

A 





8/7 

4 


2697 

C 





8/8 

3 

FI (A-6) 

2695 

B 


PSTN 

- 1 0 

0.0 

10/10 

5 


T2' - Configuration T2 with M , » 1/2 nominal M , . 

ES 6 ES 

"V 

NOTES: • FCS Dynamics: e , where (t_J » [seconds] 

, where [X^] ■ [radian/sec] (See Section 2.2) 

-Try? 

e is the amount of transport (pure) time delay 
introduced; see Section 2.4 for complete 
description of the time delay network. 

« PIOS Filter: See Section 2.3 
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The pilot ratings (PR) and PIO ratings (PIOR) are based on the Cooper- 
Harper pilot rating and PIO classification/rating scales, respectively (Section 
3.3). The safety pilot rating (SPR) is also included in the table to assist the 
analyst in evaluating the data. This rating was given independently by the 
safety pilot and is really a measure of the observed task performance. 

The pilot comments from each evaluation are given in Appendix I. 

Task performance records from selected landings are presented in Appendix II. 
These task records are time histories of the approach and landing task start- 
ing at runway realignment and ending just prior to main gear liftoff on takeoff. 

The pilot rating data is presented in a slightly different format to 
facilitate comprehension of the experiment results. In Figure 4-1, the effects 
of the position PIOS filters on the flying qualities of configurations TO and 
T2 are shown. The symbols represent the mean pilot rating where multiple 
evaluations of a configuration were performed. The pilot rating extremes are 
indicated by the vertical lines. Lines are drawn, based on the data, approx- 
imating the change in pilot rating for increasing gain attenuation (CW) with a 
position PIOS filter for each of the three values of gain attenuation breakpoint 
(1/711 N ) . 


The effects of the position PIOS filters on the secondary configura- 
tions (Configurations T1 and FI) are illustrated in Figure 4-2. The same sym- 
bology is used in this figure when multiple evaluations were performed. 

Finally, the erfects of the rate PIOS filters are depicted in Fig- 
ure 4-3. Rate PIOS filters were evaluated only with Configurations TO and T2. 

Two augmented aircraft configurations were evaluated but not flown 
with PIOS filters. These were designated Configurations T2' and T3. Config- 
uration T3 was the baseline augmented aircraft with 160 milliseconds of transport 
time delay added to the control system. This configuration was flown on the first 
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Slope (CM) 


Figure 4-2: EFFECT OF POSITION PIOS FILTER ON LANDING FLYING QUALITIES 

[CONFIGURATIONS T1 AND Fll 









Figure 4-3: EFFECT OF RATE PIOS FILTER ON Uto 

CONFIGURATIONS TO (•) 
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flight to establish its flying qualities for possible investigation of PIOS 
filtering. It was not, however, used. 

Configuration T2' was evaluated on Flight 2696 (see Table II). Config- 
uration T2 ' is identical to Configuration T2 except its pitch command gain, l-L , , 
is one-half the nominal value. This evaluation was an approximation of flying 
Configuration T2 with a "saturated" PIOS filter (XK B 0.1) . 

A comparison of the nonlinear gradient for Configuration T2' and 
the nonlinear gradient which results when a PIOS filter becomes saturated 
is shown in Figure 4-4. Configuration T2' was flown with the intent to test 
if a PlO-prone aircraft's flying qualities could be improved by merely de- 
creasing the pilot's control authority rather than adaptively reducing pitch 
commands with PIOS filters. Whether the evaluation of Configuration T2' 
achieves its intended purpose depends on the validity of approximating the 
saturated nonlinear gradient. Nevertheless, decreasing the command gain of Con- 
figuration T2 by one half did not improve its flying qualities. Configuration 
T2' was rated identical to Configuration T2 (PR»9). 

4.3 INTER/ INTRA-PI LOT RATING COMPARISON 

Each of the evaluation pilots in this flight prorram adhered care- 
fully to the evaluation task and provided invaluable pilot commentary despite 
numerous evaluations of marginally controllable aircraft configurations. 

Proof that the pilots stuck to the task and precisely followed the pilot rat- 
ing decision tree is evident by the comparison cf inter-pilot ratings (eval- 
uations of the same configuration by two different pilots) . This correlation 
is presented in Figure 4-5. The inter-pilot rating difference was very small 
as judged by all ratings being within t 1 pilot rating. 

Although only a few repeat evaluations were performed (a pilot 
evaluating the same configuration), the same consistency in performing the 
task and in assigning pilot ratings was evident in repeat evaluations. There 
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Configuration T2 
with XK • 0.1 






was, however, one exception which is more indicative of the erratic nature of 
the configurations with PICS filters instead of inconsistency on the part of 
the pilots. 

On Flight 2695, Pilot B, unknowingly, evaluated Configuration T2(A-2) 
twice. On the first evaluation, few flying qualities deficiencies were noted 
and a pilot rating of 5 was given. On the second evaluation. Pilot B elected 
to fly three approaches, attempting to sort out the flying qualities of the con- 
figuration. Although only one pilot rating was given for the entire evaluation 
(PR-9), an indication of the different performance that was achieved is given 
by the safety pilot ratings of 10, 6 and 8 for each of the three landings. 
Apparently, the position PIOS filter created very different appearing flying 
qualities depending upon the piloting technique. Detailed analyses have not 
been performed, but evaluations of several PIOS filters show similar erratic 
performance tendencies. More extensive analysis of the data should be per- 
formed to investigate this characteristic. 

4.4 COMPARISON OF EXPERIMENT RESULTS WITH OTHER DATA 

The pilot evaluations of the augmented aircraft configurations from 
this experiment are compared to other flying qualities data to provide a foun- 
dation for further discussions of the PIOS configurations. 

• Configuration TO: PR ■ 2, 2, 5 

This configuration is essentially LAHOS Configuration 2-1 with 
a nonlinear gradient, slightly higher command gain, and digital 
time delay (approximately 2G milliseconds).. From the LAHOS 
program (Reference 2), Configuration 2-1 was given, on two 
evaluations, a pilot rating of 2. The changes in this program 
to create Configuration TO apparently had little effect on the 
flying qualities of LAHOS Configuration 2-1. 

e Configuration FI: PR - 7, 8, 7 

This configuration was LAHOS 2-4 modified with a nonlinear 
gradient, slightly lower command gain, and digital time delay. 
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LAHOS Configuration 2-4 was evaluated once in the approach and 
landing task, and received a pilot rating of 9. 

• Configurations TO, Tl, T2 and T3: 

Prior to the start of evaluation flying, previous landing fly- 
ing qualities data generated with the variable stability NT-33 
aircraft were used in selecting the additional tine delay re- 
quired with Configuration TO to create the desired additional 
configurations. These data have been extensively analyzed by 
the McDonnell Aircraft Company (MCAIR) using the Equivalent Sys- 
tems approach. These studies were referenced accordingly. A pi- 
lot rating functional has been formulated from the data showing 
the degradation of landing longitudinal flying qualities with 
equivalent time delay (References 8 and 9). The comparison of 
this pilot rating functional and the evaluations of configura- 
tions TO, Tl, T2, and T3 is given in Figure 4-6. The results 
of this program correlate very strongly with the Equivalent 
Systems, pilot rating functional. 

4.5 EFFECTS OF PIOS FILTERING 

The preceding section has shown that the flying qualities of the 
aircraft configurations were well established and substantiated by previous 
flying qualities data. This strong foundation for the experiment group facil- 
itates the analysis of PIOS filtering. Although no detailed analyses have 
been undertaken, several observations concerning evaluations with the PIOS 
filters are made to complete the documentation of the experiment results. 

Figures 4-1, 4-2, and 4-3 have been drawn illustrating the effects 
of PIOS filtering on landing flying qualities from this program. Figure 4-1, 
in particular, indicates that a position PIOS filter can be designed such that 
unacceptable aircraft flying qualities, characterized by Configuration T2, 

i 

j can be improved by adding PICT filters to the pitch control system. However, 

i 

j this conclusion and any others drawn solely from the pilot rating data are 

i 

i 

s 
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Figure 4-6: DEGRADATION OF LANDING LONGITUDINAL FLYING QUALITIES 

WITH INCREASING EQUIVALENT TIME OELAY 




43 




improper. Full regard must be given to the associated pilot commentary in 
interpreting the pilot rating data. 

Configuration T2, ir. the absence of PIOS filtering, was evaluated 
as having unacceptable longitudinal landing flying qualities. Evaluations of 
Configuration T2 with position PIOS filtering showed improved pilot ratings 
with increased input suppression (Figure 4-1). For example, adding a position 
PIOS filter with a gain schedule breakpoint equal to 0.00, yielded improving 
flying qualities as a function of increasing gain schedule slope (CW) (the 
amount of input suppression). Configuration T2(A-6) (slope « -1.0] was rated 
a mean PR»7.5; Configuration T2(A-2) [slope ■ -S.0] was evaluated a mean 
PR»7; finally, Configuration T2(A-1) [slope ■ -10.0] was rated a mean PR=4.5. 
Closer examination of these evaluations through review of the pilot comments 
shows some interesting characteristics of the filters. Conclusions cannot 
be drawn without more detailed analyses, but general observations are made 
which arc warranted for documentation of the experiment results and subse- 
quent analysis. 

As noted, increasing pilot input suppression ( from a position PIOS 
filter with a gain schedule breakpoint equal to 0.0) improved the flying qual- 
ities of aircraft Configuration T2 as gauged by the mean pilot ratings. In- 
creasing the gain schedule slope changes how the filter interacts with the 
pilot and the amount of "adaptive" pilot input suppression. The three values 
of gain attenuation slope (CW) evaluated with the PIOS filter described above 
and aircraft Configuration T2 illustrate this point. 

In the evaluation of Configuration T2(A-6), the PIOS filter was not 
very active in terms of changing gain attenuation (XK). The value of XK was 
relatively constant, thus little adaptive gain changing occurred (see Appen- 
dix II for landing time histories). The pilot ratings for this configura- 
tion were nearly the same as those given for the baseline aircraft without 
PIOS filtering (Configuration T2) . The pilot comments indicated that the 
filter had little effect other than to decrease the aircraft's control auth- 
ority and initial pitch response. 
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Increasing the gain attenuation slope further (as characterized by 
Configuration T2(A-2)) created a PIOS filter which was very interactive with 
the pilot in the landing flare because of continual changes in input sup- 
pression (XK). The filter was very "adaptive" in nature. Consequently, erratic 
pilot/airplane system performance was seen. This erratic performance was de- 
scribed in Section 4.3 and illustrated by the time histories included in Appen- 
dix II. 


Finally, the position PIOS filter with a gain schedule slope of -10.0 
(Configuration T2(A-1)) produced the best landing flying qualities with air- 
craft Configuration T2 (mean PR»4. 5) . Interestingly, the PIOS filter was satur- 
ated (XK*0. 1) for almost the en ire landing flare. Little adaptive gain 
changing or interaction with the pilot was, therefore, exhibited. The pilot 

was essentially flying Configuration T2 with a reduced (constant), nonlinear 
command-gradient . 

Based on the results from evaluations of Configuration T2(A-1), an ap- 
proximation of flying a saturated PIOS filter (XK»0.1) was attempted (Section 4.2). 
This attempt (Configuration T2') was made to investigate if improved landing 
flying qualities could be achieved without the adaptive algorithm by just re- 
ducing the available command gain. Detailed analyses have not been performed 
but the data from the evaluations of Configurations T2(A-1) and T2' should be 
examined to explore the effects of PIOS filtering. 

The same PIOS filter, which greatly improved the landing flying 
qualities of Configuration T2, was flown with another PlO-prone aircraft, Con- 
figuration FI. The flying qualities of this configuration (Configuration 
Fl(A-l)) did not improve. In fact, none of the filters added to Configura- 
tion FI showed much impro\ement in the configuration's flying qualities. 

Although analyses have not been completed, it is likely that the sluggish 
initial pitch response of Configuration FI compounded by the reduced control 
authority from the position PIOS filters outweighed any potential benefit of 
the adaptive filters. When these same filters were flown with a good flying 
aircraft configuration (Configuration TC) or an acceptable, but not totally 
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satisfactory airplane (Configuration I'D, little change in landing flying 
qualities occurred. 

The comments from Pilot B's evaluations were particularly interest- 
ing since lie participated extensively as an evaluation pilot investigating 
PIOS filtering prior to this program. His experience stems from the PIOS 
filter investigations at NASA/DFRC using the F-8 DFBW in a simulated aerial 
refueling task. In several cases. Pilot B made comments which reluted his 
past experiences to this program. These comments were extremely interesting 
for comparison of the respective evaluation tasks as well as providing an ex- 
perienced voice reflecting a pilot's viewpoint of PIOS filtering. These 
comments are included in the pilot comment summaries when made with regard to a 
particular configuration. It should be remembered that Pilot B did not, at 
any time, know the configuration characteristics being simulated nor if a PIOS 
filter was implemented. 

It should also be noted that in only one insta*:ce did Pilot B make 
mention of a configuration which acted like a PIOS filter he was accustomed 
to flying from the F-8 program. This configuration was Configuration T2(A-1) 
which, as stated above, the time histories from this evaluation showed that 
the PIOS filter was saturated (XK»0.1) for most of the flare to touchdown. 

As a general comment. Pilot B questioned the difference between a 
trimmed versus untrimmed task with a PIOS filter operational. His remarks 
were not related to any specific configuration but the comment does reflect 
an important consideration in comparing the landing approach task ar.d other 
evaluation tasks during PIOS filter investigations. Pilot B hypothesised 
that the PIOS filter operates in a more noticeable fashion to the pilot in the 
landing task rather than the aerial refueling task. In the aerial refueling 
task, the mean stick force or displacement is equal to zero because the air- 
craft is trimmed at the proper airspeed for the task; whereas, the landing 
task dictates increasing aft stick forces to bleed off airspeed in the flare 
with the aircraft trimmed for the approach. Since the pilot is operating 
about a steady state, non-zero, stick position in the landing task, any 
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change that the PIOS filters make in changing the nonlinear command gradient 
(XK) should be quite evident to the pilot. On the other hand, command gain 
changes by the PIOS filters during the aerial refueling task should not be as 
noticeable because the pilot inputs are centered about zero stick displace- 
ment. As illustrated in Figure 2-5, changes in the nonlinear command gradient 
due to variations in XK are greater about a non-zero stick displacement than 
they are about the zero steady-state stick position. Hence, the difference 
between a trimmed and untrimmed evaluation task may be an important aspect in 
analyzing the experiment results and, in particular, the pilot commentary. 

This hypothesis was made by Pilot B as a general comment and was not related 
to any single configuration. The issue is relevant, nonetheless, and should 
be considered for further investigation. 

Only five evaluations of rate PIOS filters were performed. The 
results are generally inconclusive. Although the underlying concept behind 
the rate PIOS filters is the same as the position PIOS filters (that is, the 
pilot coumand to the appropriate control surface is reduced as the "PlO-condition" 
is approached), the different filter mechanization created very different 
pilot/aircraft response characteristics. As a general remark, the rate PIOS 
filters that were flown did not improve landing flying qualities and, in two 
cases, very serious control problems were evident (PR-10); however, on one of 
these evaluations rated as uncontrollable (Configuration T2(F-8)), the sup- 
pression filter was never active (XK-1.0). This case would be identical to 
flying the baseline aircraft Configuration T2. Clearly, more definitive 
examination of the data is required to clarify these results. 

4.6 EVALUATION TASK 

The results of this experiment — the pilot ratings and comments — 
illustrate that the definitive task for the evaluation of landing flying quali- 
ties was the flare and touchdown. Even though the takeoff portion of the over- 
all task was, at times, as difficult as the flare, flying qualities deficiencies, 
if they were present, were exposed during the last 50 ft of the approach to touch- 
down. Repeatedly the comment was made that the approach task was no problem. These 
observations again substantiate that the flare and touchdown tasks are required 
for the evaluation of landing flying qualities. 
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j The variety of wind and turbulence conditions for this program should 

be carefully weighed in the analysis of the data. It was noted several tines 
by the evaluation pilots that they were, to some degree, forewarned of poten- 
tial PlO-prone configurations on approach by delayed pitch attitude responses 
to their inputs. Any influence that this may have had on their evaluations can 
be extracted by comparing evaluations from Flights 2693 and 2694. On these 
flights, the light to moderate turbulence effectively masked the aircraft's 
pitch response on approach. Consequently, the evaluation pilots could not discern 

1 

on approach if lags or delays were present and an element of surprise was added I 

to the landing task. Yet, in all cases, each pilot approached the task with j 

the same, consistent level of aggressiveness and performance standard. As al- ] 

ways, the pilot ratings alone cannot be used in any analysis of the experiment j 

results. The pilot comments must be referenced with the pilot rating data to ; 

examine the effects of PIOS filters on landing flying qualities. j 

I 
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Section 5 

CONCLUDING REMARKS 

An in-flight investigation of Pilot- Induced Oscillation Suppres- 
sion (PIOS) filters was performed using the AFFDL variable stability NT-33 air- 
craft operated by Calspan. Forty evaluations of 27 configurations were flown 
in eight flights. The data generated in this experiment are in the form of 
pilot ratings, pilot comments, and task performance records (time histories). 
Although detailed analyses have not been performed, the data indicate that: 

• Actual landings and subsequent takeoffs (touch-and-go's) are 
required for the proper evaluation of landing flying qualities. 

• PIOS filters can be designed such that the flying qualities 
of an aircraft configuration which exhibits pilot-induced 
oscillation tendencies can be improved by adding PIOS filters 
to the pitch control system. 

• The ability of PIOS filters to improve flying qualities, however, 
is dependent not only on the filter design but also on the char- 
acteristics of the aircraft configuration. For example, the 
data suggest that a PIOS filter which improves the flying quali- 
ties of a configuration compromised by control system time delay, 
will slightly degrade the flying qualities of a configuration 
that is characterized by excessive control system f Uteri g. 

• The PIOS filters tested in this experiment did not degrade good 
longitudinal aircraft flying qualities to the extent that de- 
sired performance was not attainable. 

• Very erratic pilot/airplane system performance is evident when 
the PIOS filter is very "active" about the same operating point 
(for example, stick displacement) that the pilot is also con- 
trolling the aircraft. 


49 


• The data generated in this program are suitable for 
more extensive analyses to explore the effects of 
PIOS filter. 
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Section 6 
RECOFWENDATIONS 


The results of this program provide an excellent foundation for 
analyses to explore the effects of PIOS filtering on the longitudinal land- 
ing flying qualities of fighters. The following recommendations for future 
work are drawn based on this work. 

e A follow-on program should be undertaken to investigate: 

1) The effects of different internal PIOS filter implementa- 
tions (for example, different position PIOS filter time 
constants) on fighter aircraft landing flying qualities. 

2) The interaction between various short period dynamic charac- 
teristics and PIOS filtering. 

3) The flying qualities of a PlO-prone configuration with a 
saturated PIOS filter. 

4) The influence of actuator rate limiting in conjunction 
with PIOS filters on landing flying qualities. 

• Detailed analyses should be performed to interpret the config- 
uration flying qualities of this investigation. This effort 
should include the development of closed-loop pi lot/ aircraft 
models for flying qualities analysis, 

• Portions of this experiment should be repeated on a modem, 
sophisticated ground simulator to document suspected differences 
between the in-flight and ground simulators for the evaluation 
of approach and landing longitudinal flying qualities. 

• Portions of this experiment should be repeated using the DFBW/ 

F-8 in the simulated aerial refueling or longitudinal target 
tracking tasks to examine the effects of task in the evaluation 
of PIOS filtering and aircraft flying qualities. 
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• Future in-flight investigations of PIOS filters should examine 
the influences of a trimmed versus untrimmed evaluation task 
on the flying qualities of aircraft using PIOS filtering. The 
PIOS filters should also be tested in applications for the 
suppression of lateral pilot-induced oscillations. 
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Appendix I 

PILOT COMMENT SUW1ARY 

Summaries of the pilot comments from each evaluation are presented on 
the following pages of this appendix. These comment summaries are based on the 
recorded comments made by each pilot in reference to the comment card (Figure 
3-4). Comments on the lateral-directional characteristics are not included be- 
cause the pilots consistently indicated that the r e characteristics were excellent 
and, therefore, not a factor in the evaluations. 

The headings on each pilot comment summary list pertinent information 
concerning the evaluation configuration characteristics and task environment. 

The configuration identifier (Section 2.5) is given for each evalua- 
tion with the assigned pilot rating (PR), safety pilot rating (SPR), and PIO 
classification rating (PIOR). If any change in these ratings were made, this 
decision is reflected in the summary remarks. 

For reference, the experiment variables consisting of the configura- 
tion control system dynamic elements and PIOS filter are given. A dashed line 
(— ) is placed under the appropriate heading if any of these elements were 
not included in the configuration. The PIOS filter characteristics are defined 
by the slope (£V) and breakpoint ( WMIIJ ) of the gain attenuation schedule (Sec* 
tion 2.3). The type of PIOS filter is identifiable by the configuration iden- 
tifier. The control system dynamic elements are the control system time delay 
8 

(e D , where is in units of seconds) or first order, iag prefilter 
(XyYs-fA^with in units of radians per second). These elements were added 
to the baseline augmented aircraft configuration to create the experiment control 
group of longitudinal augmented aircraft configurations (Section 2.2). 

The flight number and order of the evaluation are also listed. For 
example, 2692-2 signifies that the evaluation was flown on Flight 2692 and it 
was the second configuration evaluated on thac flight. The evaluation pilot is 
also specified. 
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Finally, the headwind and crosswind magnitudes (in knots) at the time 
of the evaluation are given including a qualitative assessment of the turbu- 
lence level described by the safety pilot. 

Even though the pilot rating data suggests little difference between 
the evaluations by the three pilots, the manner in which each pilot approached 
the evaluation was slightly different. These differences may be instructive to 
the analyst when reviewing the pilot comments, since they give insight into the 
effects of PIOS filtering. For this reason, several observations on each of 
the pilot's flying/evaluation techniques are noted: 

• Pilot A (the "primary" evaluation pilot) followed the pilot com- 
ment card very closely. His piloting technique could be con- 
sidered exploratory in nature because, on most evaluations, he 
tried different ways to fly the configuration, yet still peiform 
the task. In any case, the techniques he used were explai 
fully, and he extrapolated this effort or required compensation 
very astutely into the pilot rating/evaluation process. Conse- 
quently, his evaluations were realistic in terms of the perfor- 
mance that can be consistently obtained with a configuration while 
various techniques to control the aircraft were explored. 

• Pilot at times, gave narratives in an attempt to explain what 
he saw rather than following the comment card to the letter. 

His experiences in previous PIGS filters studies were sometimes 
related to what he saw in thi-i program. Pilot B's piloting tech- 
niques could be classified ai "smoother" than Pilot A's and 
Pilot B was usually willing to stay in a PIO in an attempt to 
control it. These techniques were likely the result of his past 
experiences with marginally controllable aircraft. 

Pilot B nevertheless, evaluated configurations on their merit 
alone and not on his specialized piloting techniques. 

• Pilot C flew only one evaluation flight but acted as the safety 
pilot for the evaluation flights with Pilots A and B. The 



results of his flight are instructive to f e analyst as a fresh 
look at the configurations. Pilot C was very familiar with 
the task and peculiarities of landing the NT-35 aircraft, so 
learning curve effects were not a factor. (Pilots A and B 
flew familiarity/practice evaluation flights prior to the 
start of evaluation flying to minimize learning curve effects)* 

Overall, each of the pilots was extremely consistent in evaluations 
and very skilled in their trade. Their strict adherenco to the task and frank 
pilot comments made the successful completion of this program possible and the 
data invaluable. 
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INITIAL REMARKS: Good flying airplane. 


FEEL SYSTEM CHARACTERISTICS: Forces/displacements/sensitivity : good, satisfactory 


PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


- Good, no compensation required. 

- Even with high pilr. gain, no problems with 
controlling final .‘esponse. 

- Good. 


PILOT- IN-THE-LOOP: 

- PIO Tendency? - Tried to be extra aggressive on "go" using sharp 

inputs, yet no PIO tendency. 

- Piloting Techniques? 

- Small Large Inputs? * No differences noted. 

- Open vs. Closed-Loop Control? - No PI ° tendency at all. 


TASK PERFORMANCE : 

- Airspeed Control 

- Touchdown Point Accuracy 


- Good . 

- Good, well within limits. 


- Sink Rate at Touchdown ~ Satisfactory. 


. Runway Alignment 

- Aggressiveness 

- Task Differences 


- Good. 

- Normal level of aggressiveness used although not 
concerned if large inputs required near ground. 

- No differences in terms of performance. 


ADDITIONAL FACTORS: - None. 




SUMMARY: 
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• INITIAL REMARKS: Good configuration. 

• FEEL SYSTEM CHARACTERISTICS: All OK. 


ora'sir:^ vr><y.: 

OF POOR QJALiTY 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

• Final Response? 

- Predictability? 


- Very nice. 

- Like the base airplane. 

- Very good. 


• PILOT- IN-THE-L00P: 

- PIO Tendency? 

- Piloting Techniques? 

- Small vs. Large Inputs? - No differences 

- Open vs. Closed-Loop Control? 


- No PIO tendency. 

- None required. 


• TASK PERFORMANCE: 

Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: 
e SUMMARY : 


- 0'<; st 4 .ll a little unsure of T-33's 
throttle response. 

- Good, within limits. 

- Good. 

- Good. 

- Fairly aggressive. 

- No apparent differences. 

- None. 
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• INITIAL REMARKS: Pitch response seemed a little lagged. 


• FEEL SYSTEM CHARACTERISTICS: Used larger than desired displacements (minor 

deficiency), low sensitivity. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? -Satisfactory. ORi3H'iAt 

OF POOR QUALIFY 

- Final Response? 

- Predictability? - Yes. 


• P I LOT - IN-THE - LOOP : 

- PIO Tendency? - None. 

- Piloting Techniques? - No special techniques required. 

- Small vs. Large Inputs? 

- Open vs. Closed-Loop Control? - Can be aggressive with airplane and feel 

connected one-to-one with it. 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- Good. 

- No problems with airplane. 

- Good. 

- Could use whatever level I choose. 

- No differences noted. 


• ADDITIONAL FACTORS: - Slight crosswind becoming a factor. 

• SUMMARY: Debated between PR«2 and PR=3. 
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• INITIAL REMARKS: Don't like the force levels in flare. Felt like bottom 

fell out right at the end. 

• FEEL SYSTEM CHARACTERISTICS: Forces heavy, displacements large, and would 

• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 

• PI LOT- IN-TOE -LOOP: 

- PIO Tendency? 

- Piloting Techniques? 

- Small vs. Large Inputs? - No comment. 

- Open vs. Closed-Loop Control? - No difference. 

• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runwa, Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: 

e SUMMARY: Only problem with this configuration was the large aft stick and 

loss of pitch sensitivity near end of flare. 


- Satisfactory. 

- Within limits. 

- Good. 

- No problem. 

- Normal level of aggressiveness. 

- No differences except high forces in flare. 

- Slight crosswind added to task/worklcad. 

Had no problems with it. 


like more pitch sensitivity. 

- Reasonable. 

- Reasonable and predictable. 

- Yes. 

OrUGjL'.-- 'i'is ) 

OF POOR QUA.UTY 

- None. 

- Flew airplane naturally and I got the job done. 
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• INITIAL REMARKS: Airplane didn't flare as smoothly as would have liked 

but overall a nice flying airplane. 

• FEEL SYSTEM CHARACTERISTICS: Forces/displacements: OK. Sensitivity - not 

quite adequate in the flare but not poor by 
any means . 

• PITCH ATTITUDE CONTROL: 


- Initial Response? . Good. 

- Final Response? _ a little heavier than desired. 

- Predictability? - OK but could control other configurations 

more precisely. 

• PILOT-IN-THE-LOOP: 


- PIO Tendency? 

- Piloting Techniques? 


- No, even when intentional high gain type 
inputs used. 

- Not aware of any. 


- Small vs. Large Inputs? - Not as much pitch rate in proportion for 

large inputs. 

- Open vs. Closed-Loop Control? . No differences. 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- Acceptable. 

- Floated a bit on the second landing. 

- Could have been a little better. 

- OK. 

- Felt comfortable with airplane when 
aggressive near ground. 

- Little differences. 


• ADDITIONAL FACTORS: - Crosswind, but not an influence on rating. 


• SUMMARY: 

ORIGINAL PAC-'-i [?, 

OF POOR QUALITY 
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INITIAL REMARKS: Good airplane. 


FEEL SYSTEM CHARACTERISTICS: Satisfactory. No problem with displacements. 


PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


- As desired. 

- Good. 

- Excellent. 


PILOT-IN-THE-LOOP: 

- PIO Tendency? 

- Piloting Techniques? 

- Small vs. Large Inputs? 


- None. 

- None. 

- No differences. 


- Open vs. Closed-Loop Control? - Well behaved aircraft with pilot in or 

out of control loop. 


TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- Good. 

- Good. 

- Good. 

- Satisfactory, offset was easily performed. 

- Didn't hesitate to be aggressive. 

- No differences noted. 


ADDITIONAL FACTORS: - None. 


SUMMARY: Felt very comfortable with airplane. 
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• INITIAL REMARKS: Very slight pitch bobble noticed. 

• FEEL SYSTEM CHARACTERISTICS: 

• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? - Very predictable. 

• PILOT- IN-THE-LOOP: 

- PIO Tendency? - No, maybe slight susceptibility for 

undesirable motions. 

- Piloting Techniques? - None. 

- Small vs. Large Inputs? - Would have felt confident using either 

large or small inputs. 

- Open vs. Closed-Loop Control? 

• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

• ADDITIONAL FACTORS : 

• SUMMARY: 


- Good. 

- Fine. 

- Good. 

- Good. 


Weather added to task; slight wind shear 
on final. 
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• INITIAL REMARKS: 


• FEEL SYSTEM CHARACTERISTICS: Forces/displacements satisfactory. Pitch sensitivity 

acceptable, although may be a little insensitive. 


• PITCH ATTITUDE CONTROL: 


- Initial Response? 

- Final Response? 

- Predictability? 


- OK but a little slow. 

- No overcontrol tendencies. 

- Good. 


• PILOT- IN-THE-LOOP: 

- PIO Tendency? - No, maybe a little pitch nodding though. 

- Piloting Techniques? - Not aware of any. 

- Small vs. Large Inputs? " No difference. 

- Open vs. Closed-Loop Control? 


• TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 
• Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- OK. 

- Within limits, but floated a bit on each landing. 

- Satisfactory. 

- Satisfactory. 

- A little less aggressive than might have been 
with best airplane. 

- None noted. 


• ADDITIONAL FACTORS: - None. 


• SUMMARY: No change in ratings. 
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• INITIAL REMARKS: 


• FEEL SYSTEM CHARACTERISTICS: Forces satisfactory. Noticed tendency to pump 

stick. Sensitivity sluggish. 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


- Not quick; lagged/delayed. 

- Unsure of final response, overcontrolled. 

- Cannot be extremely precise. 


• P I LOT - IN-THE - LOOP : 

- PIO Tendency? - Slight. 

- Piloting Techniques? - Tried to avoid very tight aggressive control. 

- Small vs. Large Inputs? “ No differences detected. 

- Open vs. Closed-Loop Control? - PIO tendency seen only during closed loop. 


• TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


Not very good. 

Poor because of problems controlling 
pitch attitude. 

Higher tha**. desirable. 

Crosswind made alignment more difficult. 

Did not want to get that aggressive. 

Landing and takeoff more difficult. 


e ADDITIONAL FACTORS: 
• SUMMARY: 


Crosswind/turbulence adds to task workload. 
Realistic conditions. 
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• INITIAL REMARKS: Turbulence, wind and crosswind make task different 

and more difficult than before. 

• FEEL SYSTEM CHARACTERISTICS: No comments. 


PITCH ATTITUDE CONTROL: 


- Initial Response? 

- Final Response? 

- Predictability? 


• Delayed. 

- Cannot accurately judge amount of response 
associated with input. 

- Lacking. 


e PILOT-IN-THE-LOOP: 


- PIO Tendency? 


- Undesirable motions. 


- Piloting Techniques? - Not aware o f an Y- 

- Small vs. Large Inputs? - No difference. 

- Open vs. Closed-Loop Control? 


e TASK PERFORMANCE: 


Airspeed Control 


- Complicated by wind shear but no problems 
due to aircraft. 


- Touchdown Point Accuracy - No problems due to configuration. 

- Sink Rate at Touchdown - Firm but acceptable. 


- Runway Alignment 

- Aggressiveness 

- Task Differences 


- Good. 


- Fairly high. 


e ADDITIONAL FACTORS: 


- Slight wind shear on final. 


e SUMMARY: Evaluation as well as task complicated by weather since one 

cannot tell if airplane is acting in response to pilot inputs 
or weather. 
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• INITIAL REMARKS: 

• FEEL SYSTEM CHARACTERISTICS: 

• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 

• PI LOT- IN -THE -LOOP: 

- PIO Tendency? 

- Piloting Techniques? 

- Small vs. Large Inputs? 

- Open vs. Closed-Loop Control? 

• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: 
e SUMMARY: 


original r;.r ; [j 

OF POOR QUALITY 


Pilot comments lost - 
voice recorder malfunction 
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INITIAL REMARKS: Not too bad of an airplane except for the pitch 
response in flare. 

FEEL SYSTEM CHARACTERISTICS: 


PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


- Just slightly sluggish. 

- More response than expected based on initial 
response. 

- It is predictable - not frightened by it. 


PILOI -IN-THE-LOOP : 

• PIO Tendency? - No oscillations, but undesirable notions 

because of mismatch between initial and final response 

• Piloting Techniques? - Had to use small inputs. 

- Small vs. Large Inputs? - Airplane's bad characteristics appeared when 

making large inputs to put airplane on the ground. 

• Open vs. Closed-Loop Control? 


TASK PERFORMANCE: 


- Airsp« id Control 

• Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- No comment. 

- First landing a little long. Second OK. 

* Acceptable. 

- Fair amount of aggressiveness 

- Landing task rather than approach or take off 
is where bad characteristics showed up. 


ADDITIONAL FACTORS: 


SUMtARY: 
















• INITIAL REMARKS: Significant control problems on first landing - 2nd approach/ 

landing performance was better out not great. 

• FEEL SYSTEM CHARACTERISTICS : Displacements seemed large. Pitch sensitivity 

poor, lagged. 

• PITCH ATTITUDE CONTROL: 


- Initial Response? 

- Final Response? 

- Predictability? 


- Not there, delayed. 

- Confusing response with pilot in loop. 


- None at all. 


• PILOT- IN-THE-LOOP: 


PIO Tendency? 


Piloting Techniques? 


- Yes, low frequency PIO near ground. 

- Tried to use small inputs or back off from task, 


- Small vs. Large Inputs? - No differences noted. 

- Open vs. Closed-Loop Control? PI ° with closed loop, high gain control 


• TASK PERFORMANCE: 


Airspeed Control 


Adequate . 


- Touchdown Point Accuracy " Wel1 past on first landing, within limits on second. 


Sink Rate at Touchdown 


Not really all that controllable. 


- Runway Alignment 

- Aggressiveness 

- Task Differences 


# ADDITIONAL FACTORS : 


- OK. 

- Tried as hard as possible. 

- Second takeoff caused PIO. Approach can be 
flown satisfactorily. 

- SP: get crosswind disturbance from left 

at threshold. 


• SUMMARY: 
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• INITIAL REMARKS: Waved off first approach because of unpredictable 

pitch r.ttitude response. 

e FEEL SYSTEM CHARACTERISTICS: 


e PITCH ATTITUDE CONTROL: 
• Initial Response? 

- Final Response? 

- Predictability? 


• Kind of sluggish. 

- Overshoots. 

- Nore. 


e PI LOT- IN-TOE -LOOP: 

- PIO Tendency? - Yes. 

- Piloting Techniques? - Used small input, open loop type control. 

- Small vs. Large Inputs? - Would not want to make large inputs near ground. 

- Open vs. Closed-Loop Control? - Tried to avoid closed loop control. 


a TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: 
e SUMMARY: 


- Poor. 

- Poor. 

- Too high. 

- Good. 

- Could not be aggressive. 

- None. 


n 
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• INITIAL REMARKS: 


• FEEL SYSTEM CHARACTERISTICS: Displacements quite noticeable, large. Forces 

didn't seem that high. Sensitivity delayed. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? - Was there; lagged, delayed. 

- Final Response? 

- Predict i'ity? - Not there. 


• P I LOT- IN -THE - LOOP : 

- PIO Tendency? - v cs, certainly. 

- Piloting Techniques? - Tried to do e/erything just to put airplane 

safely on ground. 

- Smal vs. Large Inputs? 

Open vs. Closed-Loop Control? 


e TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchaown 
• Runway Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: 


- A little fast. 

- Had enough problems just maintaining control. 

- Not too bad. 

- Satisfactory. 

- Got pretty aggressive although I didn't want to. 

- Yes, lending and go-around was where PTO's 
occurred. 

- A.’rplane soemed sluggish to trim. 


e SUMMARY: Possibly a PR«10 airplane. 

•Nominal configuration T2 except command gain reduced by 1/2. 
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• INITIAL REMARKS: Reasonable application of PIOS filter - had 

similar impressions as to what goes on ir. P-8. 

• FEEL SYSTEM CHARACTERISTICS: 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


• PILOT- IN-THE-LOOP: 


- Moderate, did not see any monster delays, but 
still not like base airplane. 

- No real overshoots . 

- Good. All that was required to control aircraft 
was to fly it aggressively. 


- PIO Tendency? - Some unpredictable motions not strictly 

related to control inputs. 

- Piloting Techniques? - Tried not to abandon control loop. 

- Small vs. Large Inputs? - Some unpredictable things for small inputs. 

- Open vs. Closed-Loop Control? - Always tried to stay in the loop. 


• TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- No problem. 

- Good. 

- Fine. 

- Good . 

- Flew aggressively to maintain closed loop 
control. 


• ADDITIONAL FACTORS : 

• SUMMARY : Could put aircraft where I wanted to if aggressive. 
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• INITIAL REMARKS: When near ground using small, quick inputs, couldn't 

get effective results. 

• FEEL SYSTEM CHARACTERISTICS: Forces not too high but displacements large. 

Airplane felt sensitive at first but had rather 
average to low sensitivity overall. 

• PITCH ATTITUDE CONTROL: 


- Initial Response? 

- Final Response? 

- Predictability? 


- Sluggish in flare. 

- Would have liked more responsive airplane. 

- Had problems controlling pitch especially 
on first landing. 


• PILOT-IN-THE-LOOP: 

- PIO Tendency? - Saw pitch nodding on takeoffs. 

- Piloting Techniques? - Had to anticipate pitch response. 

- Small vs. Large Inputs? 

- Open vs. Closed-Loop Control? 


• TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- Floated on second approach. Navy landing on first. 

- Too high on first. 

- Satisfactory. 

- Moderate, especially after seeing sluggish 
pitch response on first approach. 

- Landing and takeoff more difficult. 


• ADDITIONAL FACTORS: - None. 


• SUMMARY: 


1-20 


ORIGINAL -3 

OF POOR QUALITY 





















FLIGHT NO-EVAL 

PCS DYNAMICS 

1 PIOS CONFIGURATION 

CONFIGURATION 

2692-2 

mm 

wm 

SLOPE 

BREAK PT. 

T2 (A- 2) 

0.12 

- 

WBM 

0.0 

EVAL. PILOT 

wind/x-wind 

TURBULENCE 

PR 

SPR 

PIOR 

A 

04/01 

Light 

6 

8 

3 


• INITIAL REMARKS: Near ground, working airplane pretty hard. 


• FEEL SYSTEM CHARACTERISTICS: Forces OK. Stick displacements large but not as 

bad as previous configuration. Pitch not as 
sensitive as would like. 

• PITCH ATTITUDE CONTROL: 


- Initial Response? 

- Final Response? 

- Predictability? 


- Small lag, not too bad until near ground. 

- Couldn't sort it out from the initial response. 

- Good on initial part of flare; below adequate 
near ground. 


• PILOT-IN-THE-LOOP: 

- PIO Tendency? - Yes, slight tendency near ground. 

- Piloting Techniques? - Accepted higher sink rates than normal. 

- Small vs. Large Inputs? * Delay more noticeable with large inputs. 

- Open vs. Closed-Loop Control? - Problems occur. ed during closed loop 

control. 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Aucur*c> 
•• Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

• ADDITIONAL FACTORS: 


- Adequate. 

- Within the desired area. 

- A little high. 

- Good. 

- More than normal. 

- Approach easy, PIO tendency during 
touch and go. 


• SUMMARY: Had to force airplane down. Very high pilot workload to land 

within touchdown area (desired performance) . 
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• INITIAL REMARKS: Airplane has major deficiences. 

• FEEL SYSTEM CHARACTERISTICS: Displacements large in fla-e. Sensitivity 

poor; forces OK. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? - Not satisfactory, especially near ground. 

- Final Response? - Always had to lead aircraft. 

- Predictability? - Poor, overcontrolled pitch. 

• P 1 LOT- IN-THE- LOOP: 

- PIO Tendency? - Yes, when trying to touch down within 

desired area. 

- Piloting Techniques? - Get 1 , loop enough to land aircraft at 

bottom of PIO cycle. 

- Small vs. Large Inputs? - Both cases exhibit initial lag, delay. 

- Open vs. Closed-Loop Control? - No comments. 

• TASK PERFORMANCE: 

- Airspeed Control - Airspeed intentionally a little slow to achieve 

desired landing performance despite pitch control. 

- Touchdown Point Accuracy - Within limits but had problems. 

- Sink Rate at “ouchdown - Too high. 

- Runway Alignment 

- Aggressiveness 

- Task Differences Remainder of pilot comments lost because 

of voice recorder malfunction. 

e ADDITIONAL FACTORS: 


• SUMMARY: 
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• INITIAL REMARKS: Debated briefly between desired and adequate 

performance to arrive at pilot rating. 

• FEEL SYSTEM CHARACTERISTICS: 

• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 

• PILOT-IN-THE-LOOP: 

- PIO Tendency? - Not really; undesirable motions which 

compromised task performance slightly. 

- Piloting Techniques? - Not aware of any. 

- Small vs. Large Inputs? 

- Open vs. Closed-Loop Control? 

• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

• ADDITIONAL FACTORS: 

• SUMMARY: Not much improvement required to make airplane Level 1. 


- Problems on second approach. 


- Surprised that we touched down as hard as we did. 


- Reasonable aggressive at all times. 


- Some undesirable motions. 

- Minor, suitable bits of unpredictability. 
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• INITIAL REMARKS: 0° first and third approach, control authority in question; 

no problems due to phasing of aircraft response to control 
inputs. On second approach, felt out of phase with airplane, 

^ FEEL SYSTEM CHARACTERISTICS* but resultant aircraft motions seemed OK. Confusing. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 

• P I LOT - IN-THE - LOOP : 

- PIO Tendency? 

- Piloting Techniques? 

- Small vs. Large Inputs? 

- Open vs. Closed-Loop Control? 


- Control gearing too low. 

- Control system (suppressor?) seems to change 
response in flare while holding aft stick. 

- Lack of controllability. 


- Yes, but apparently not divergent oscillations. 

Results will be the same whatever the level 
of pilot compensation. 


• TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy ” First ap; ach wave off. Second approach OK. 

Third jach OK until flare. 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

• ADDITIONAL FACTORS: - On short final, configuration or whatever gave 

impression that turbulence was cutside. 


• SUMMARY: 


* SPR»10: 1st approach 

SPR* 6: 2nd approach 

SPR« 8: 3rd approach 
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• INITIAL REMARKS: Controllability of aircraft was not adequate for the task. 


• FEEL SYSTEM CHARACTERISTICS: All adequate. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? - Typical of transport delay. 

- Final Response? - Predictable but delayed in time. 

- Predictability? - Reasonable. 


• PILOT-IN-THE-LOOP: 

- PIO Tendency? - Yes - 

- Piloting Techniques? - Watch response to first input before 

attempting another. 

- Small vs. Large Inputs? - No large inputs used. 

- Open vs. Closed-Loop Control? 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 
• Sink Rate at Touchdo'm 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

• ADDITIONAL FACTORS: 


OK. 

Not good, ragged performance. 

Too high. 

Good. 

More aggressive on second landing to land 
within desired area. 

landing most difficult. 

None . 


• SUMMARY: Pilot workload was not extremely high, particularly when 

compared to the simulated aerial refueling task. 
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• INITIAL REMARKS: 


• FEEL SYSTEM CHARACTERISTICS: Forces OK; displacements objectionably large 

especially near ground. 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


- Don't get anything initially. Overcontrolled 
pitch as a result. 

- Can't figure out how much response for a 
given input. 

- Poor. 


• PI LOT- IN-TOE- LOOP: 

- PIO Tendency? - Yes, for high gai.: task near ground. 

- Piloting Technimies? - G «t it near ground, tweek airplane nose down, 

and then rotate enough to get satisfactory sink rate. 

- Small vs. Large Inputs? - With small inputs, PIO tendency not as bad. 

- Open vs. Closed-Loop Control? - Even "trim" response on approach lagged, 

poor. 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: 


- Airplane seems spe*d unstable. 

- Spiked airplane on within desired area. 

- Not great but best possible. 

- OK. 

- Got very aggressive near ground. 

- Satisfactory performance on approach, but 
PIO on landing and takeoff. 

- 


e SUMARY: 
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e INITIAL REMARKS: Debated between PR* 6 and PR«7. Airplane has major deficiencies. 


• FEEL SYSTEM CHARACTERISTICS: Forces high but acceptable in flare. Displacements 

large. Sensitivity inadequate. 


• PITCH ATTITUDE CONTROL: 


- Initial Response? 

- Final Response? 

- Predictability? 


- Saw some initial response but not adequate. 

- Not predictable. 

- Poor; overcontrolled pitch attitude in attempt 
to get adequate initial response. 


• PILOT-IN -THE -LOOP: 

- PIO Tendency? - Yes, initiated during flare. 

- Piloting Techniques? - Spiked airplane on ground, accepted higher 

sink rates. 

- Small vs. Large Inputs? - Saw control problems with large inputs. 

- Open vs. Closed-Loop Control? - No comments. 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Difference's 


Good. 

Less than satisfactorv but within desired area. 
Satisfactory, but on high side. 

Good. 

Not as aggressive as would be with nice 
flying airplane. 

Landing and go-around task were more difficult. 


• ADDITIONAL FACTORS: - N ° ne - 


• SUMARY: 
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• INITIAL REMARKS: Could tell the configuration was oscillatory final; 

therefore, suspicious during landing. 

• FEEL SYSTEM CHARACTERISTICS: 


PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 

P I LOT - IN-THE - LOOP : 

- PIO Tendency? 

- Piloting Techniques? 


- Somewhat lagged. 

- Seemed lagged also, definitely oscillatory. 

- Oscillations had some degree of predictability 
about them. 


- Yes. 


- Used pitch oscillations to control aircraft 
rather than using smooth pilot control inputs. 

- Small vs. Large Inputs? - Large inputs could be used. 


- Open vs. Closed-Loop Control? 


- More closed loop control used during 

this evaluation than others in this flight, 


9 TASK PERFORMANCE: 

- Airspeed Control - Good. 

- Touchdown Point Accuracy - OK. 

- Sink Rate at Touchdown " Firm, not hard. 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- No problem. 

- Moderately. 


e ADDITIONAL FACTORS : 


- Any pitch attitude change resulted in 
oscillatory response. 

- None. 


e SUMMARY: Pilot compensation was key to controlling this aircraft. 
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• INITIAL REMARKS: 


• FEEL SYSTEM CHARACTERISTICS: No coaments. 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


Delayed. 

"Over- response" although magnitude of over-response 
not as large as seen with some previous configurations 

Not predictable. 


• PILOT- IN-THE-LOOP: 

- PIO Tendency? - Yes - 

- Piloting Techniques? - Gently herded aircraft by intentionally 

abandoning tight control at onset of PIO. 

- Small vs. Large Inputs? - Would not want to use large inputs. 

- Open vs. Closed-Loop Control? 


e TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 
• Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- No comment. 

- Touched down inadvertently at bottom 
of PIO once. 

- OK, e irm. 


- Fairly high using special piloting technique - 
not in a continuous closed loop fashion. 


e ADDITIONAL FACTORS: - Slight wind shear on final, weather added 

to task. 


• SUMMARY: 


SP: 


erratic, small amplitude PIO's noted. 
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• INITIAL REMARKS: Noted pitch ’’nodding" about center of gravity in flare 

and takeoff. 

• FEEL SYSTEM CHARACTERISTICS: Forces not a problem. Displacements high especially 

in flare. Sensitivity average, not really sluggish 
but not quick. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? “ Slow, a little bit of delay. 

- Final Response? - Unsure of inputs required to control final 

pitch response. 

- Predictability? - Average, not really good. 

• PILOT-IN-THE-tOOP: 

- PIO Tendency? - Yes, aggressiveness near runway excited PIO. 

_ Piloting Techniques? * Tried to anticipate aircraft responses. 

- Small vs. Large Inputs? ' None detected. 

- Open vs. Closed-Loop Control? - Yes, airplane seemed reasonable open loop, 
e TASK PERFORMANCE: 

- Airspeed Control " Satisfactory. 

- Touchdown Point Accuracy “ but coul<1 improved. 

- Sink Rate at Touchdown - Acceptable but would like lower rates. 

- Runway Alignment " Satisfactory. 

- Aggressiveness " Tried to be aggressive. 

- Task Differences - Approach no problem, control problems in both 

flare and on the "go”. 

e ADDITIONAL FACTORS: * Slight crosswind a little problem. Turbulence 

not a problem. 


e SUMMARY: 
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• INITIAL REMARKS: Sneaky configuration; had to go around on second landing. 

• FEEL SYSTEM CHARACTERISTICS : 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

• Final Response? 

- Predictability? 


Some airplane responses seened imrelated 
to pilot control inputs. 


- Very little, surprising airplane responses. 


• PILOT-IN-THE-LOOP: 

- PIO Tendency'' - No PIO tendency; undesirable notions. 

• Piloting Techniques? 

- Snail vs. Large Inputs? - Equally unpredictable. 

- Open vs. Closed-Loop Control? 

e TASK PERFORMANCE: 

- Airspeed Control - Net the problem. 

- Touchdown Point Accuracy - Nithi.; limit.} on only landing. 

- Sink Rate at Touchdown - High sink rate on first landing. 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: " Gust y wind; slight wind shear, 

e SUM4ARY: 


- Gusty wind; slight wind shear. 
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• INITIAL REMARKS: Initial delay in pitch response lead to PIO. 


• FEEL SYSTEM CHARACTERISTICS : Forces not too high but displacements large. 

Quite sensitive except for initial delay. 


• PITCH ATT 7 r 'JDE CONTROL: 

- Initi'.i Response? 

- F;r.al Response? 

- Predictability? 


- Delayed. 

- Overcontrolled, out of phase with airplane. 

- Poor. 


• PILOT- IN-THE-LOOP: 

- PIO Tendency? ~ ^ es * 

- Piloting Techniques? " Not aware o£ an Y except for extensive 

compensation required to keep control. 

- Small vs. Large Inputs? - Delay independent of input size. 

- Open vs. Closed-Loop Control? - Looked like pitch rate command system 

open loop. PIO with closed loop control. 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

• ADDITIONAL FACTORS : 

• SUMMARY: Got better pitch rates for small inputs when aggressive. 


Satisfactory. 

Within the limits. 

Not satisfactory. 

Good . 

As aggressive as I would want to be. 
Landing most difficult. 


C 
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• INITIAL REMARKS: Configuration had a funny pitch attitude response. 


• FEEL SYSTEM CHARACTERISTICS: Forces OK. Displacements a little large. 

Pumped stick. 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


- Quick response initially but final response 
seemed to die out. 

- Nonlinear? 

- Not predictable because of mismatch between 
initial/final response. 


e PI LOT- IN-THE - LOOP : 

- PIO Tendency? - Yes, especially near ground with aggressive inputs. 

- Piloting Techniques? — Backed off on second approach to avoid PIO. 

- Small vs. Large Inputs? ~ For small inputs, initial response better, 

more predictable. 

- Open vs. Closed-Loop Control? - Closed loop control was the problem. 


TASK PERFORMANCE: 


- Airspeed Control 

- Not too good. 

- Touchdown Point Accuracy 

- Within the touchdown tone limits. 

- Sink Rate at Touchdown 

- OK. 

- Runway Alignment 

- Satisfactory. 

- Aggressiveness 

- Task Differences 

- Was very aggressive on first landing and got 
into a PIO which may have grown in amplitude. 


e ADDITIONAL FACTORS: 
e SUMMARY: 
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tntttai dpmadvc. Whatever is done in the control system make the smaller 

transport delays less predictable. Couldn't fly the aircraft 
by trying to control the pitch oscillations . 


• FEEL SYSTEM CHARACTERISTICS: 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


- Unpredictable nose up and nose down 
response to inputs. 

- None, even oscillations are unpredictable. 


• P ILOT - IN - THE - LOOP : 

- PIO Tendency? - Yes, large amplitude, low frequency PIO's 

- Piloting Techniques? " Go-around. 

- Small vs. Large Inputs? “ no ^ related to input size. 

- Open vs. Closed-Loop Control? 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

• ADDITIONAL FACTORS: - Gusty wind conditions, slight wind shear. 


• SUMMARY: Bad features of configuration not noticeable until flare. Without 

the gusty wind conditions which require a lot of pitch inputs, 
may not have found out about airplane deficiencies until pretty late. 
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• INITIAL REMARKS: 1st approach: Waved off; a lot of la^ in system. 

2nd approach: Hard landing; airplane sank out from underneath. 

• FEEL SYSTEM CHARACTERISTICS: Forces/displacements; satisfactory. 

Pitch sensitivity sluggish. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? - Satisfactory on approach; noticeable delay in flare. 

- Final Response? - Poor, cvercontrolled pitch attitude. 

- Predictability? " P° or * 


PILOT- IN-THE-LOOP: 

- PIO Tendency? 

- Piloting Techniques? 


- Yes, out of phase with airplane on first approach. 

- No special techniques used. 


Small vs. Large Inputs? “ For small inputs, airplane seemed controllable. 

Open vs. Closed-Loop Control? - No tendency for airplane to wander off 

open loop . 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: 


Poor on 2nd approach. 

Within limits on 2nd approach. 

Too high. 

Satisfactory. 

As aggressive as I would want. 

Landing not predictable; low frequency PIO 
on takeoff. 

None. 


1 





i 

| 
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e SUMMARY: * EP gave pilot ratings for each approach because of different 

task performance: 

1st approach: PR«10, PI0R«5 

2nd approach: PR«6, PI0R«3 
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• INITIAL REMARKS: Adequate performance but deficiences require improvement. 

• FEEL SYSTEM CHARACTERISTICS: Displacements large especially near ground. 

Pitch sensitivity poor. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? - A lot of lag; not necessarily time delay, 

just real sluggish. 

- Final Response? - Could stop pitch attitude once it got there. 

- Predictability? - Poor, never knew how much input to get 

pitch attitude. 

• PILOT-IN-THE-LOOP: 

- PIO Tendency? - Low frequency PIO. 

- Piloting Techniques? - None used. 

- Small vs. Large Inputs? - Took big inputs for control. 

- Open vs. Closed-Loop Control? - No differences noted. 


• TASK PERFORMANCE: 

- Airspeed Control - Satisfactory. 

- Touchdown Point Accuracy “ Surprised at accuracy, better than expected. 

- Sink Rate at Touchdown “ Satisfactory. 


- Runway Alignment 

- Aggressiveness 

- Task Differences 


- Good. 

- Would not like to be any more aggressive. 

- PIO during takeoff and landing phases. 


• ADDITIONAL FACTORS: " SP: 8 et *>urst °* crosswind from left 

at threshold. 


• SUMMARY: Debated between PR»6 and PR»7. 
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• INITIAL REMARKS: Appeard to be a large transport delay airplane with PIO suppressor 

which made it a low frequency, sluggish responding configuration. 

• FEEL SYSTEM CHARACTERISTICS: 


• PITCH ATTITUDE CONTROL: 

- Initial Response? - Very sluggish. 

- Final Response? - Low frequency, low amplitude PIO. 

- Predictability? - Not predictable due to variation of 

flying qualities. 

• PILOT-IN-THE-LOOP: 

- PIO Tendency? - Yes, when you are "moderately" in the loop. 

- Piloting Techniques? - Being more aggressive on second approach, made 

airplane more controllable and airplane did what 

- Small vs. Large Inputs? 1 expected. 

- Open vs. Closed-Loop Control? - Aggressive, closed loop control yields 

improved flying qualities. 

• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy - Abandoned first attempt, accurate when 

aggressive on second landing. 

- Sink Rate at Touchdown - OK. 

- Runway Alignment - Good. 

- Aggressiveness - High Cooper-Harper pilot rating due primarily to 

variation of flying qualities with level of 

- Task Differences aggressiveness. 

- Landing task by far more difficult. 

• ADDITIONAL FACTORS: 

• SUMMARY: Changed rating from PR»7 after pilot comments. 

No change in PIOR. 
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• INITIAL REMARKS: Very different airplane. Somewhat predictable in that 

you can get the job done. 

• FEEL S VC TEM CHARACTERISTICS: Not as many complaints as past. Forces/ 

displacements no problem. Adequately sensitive. 

• PITCH ATTITUDE CONTROL: 


Initial Response? 


Delayed. 


- Final Response? - After initial delay, response came on a little 

abruptly. 

- Predictability? - Degraded for tight tasks. 


• P I LOT - IN-THE - LOOP : 


- PIO Tendency? 

- Piloting Techniques? 

- Small vs. Large Inputs? 


- PIO during last 20 ft of landing task. 

- Controlled gain to keep oscillations under 
control and achieve some landing success. 

- Small, rapid ii.puts were the order of the day. 


- Open vs., Closed-Loop Control? - Didn't feel you could close the loop 

tightly. 


• TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- Satisfactory. 

- Within limits. 

- Reasonable, surprisingly so at times. 

- Had to control aggressiveness to get 
landing performance. 


e ADDITIONAL FACTORS: 


- Slight crosswind adding to workload. 


e SUMMARY: Changed pilot rating from PR»6 after pilot comments. 
No change in PIOR. 
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• INITIAL REMARKS: Ridiculous airplane. Ran out of control authority near ground. 


• FEEL SYSTEM CHARACTERISTICS: Really big displacements near ground. Pitch 

sensitivity too low in flare. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? “ Very sluggish, poor. 

- Final Response? - Cannot compensate for airplane in a predictable 

fashion. 

- Predictability? - None. 


• PILOT- IN-THE-LOOP: 

- PIO Tendency? - No real oscillations. Airplane did what it 

wanted rather than what I wanted. 

_ Piloting Techniques? - Worked hard to get nose to move. 

- Small vs. Large Inputs? - Had to use large inputs. 

- Open vs. Closed-Loop Control? ~ Didn't close the loop that tightly. 



t 

Landing performance was not bad considering ’ 

the airplane deficiencies. 

Within limits. 

Got lucky with sink rate. 


Reasonably aggressive; not that apprehensive 
about making big inputs. 

Landing by far most difficult. 

i 

e ADDITIONAL FACTORS: - Slight crosswind adding a bit to workload. 

e SUM4ARY: Not as afraid of this airplane as I was of the previous 

PR»8 airplane (Config. FI (A-2)). 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 
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IN T TIAL REMARKS' a i f pl ane smoothly on first approach because I thought sluggish 

• A * pitch response would lead to PIO. Flew second approach aggressively 

to get satisfactory pitch rates. 

• FEEL SYSTEM CHARACTERISTICS: Forces high, displacement OK. Sensitively 

low, sluggish. 

• PITCH ATTITUDE CONTROL: 


Initial Response? 
Final Response? 
Predictability? 


- It was there, pitch response just very slow. 

- Looked like a pitch rate command system. 

- Pitch rate was predictable but troubles in flare 
to get enough response for smooth touchdown. 


• PILOT-IN-THE-LOOP: 

- PIO Tendency? - No. Saw some pitch nodding on take off but 

didn't feel it was a PIO. 

- Piloting Techniques? 

- Small vs. Large Inputs? 

- Open vs. Closed-Loop Control? - Forces got heavy once in control loop. 


• TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 


- Satisfactory. 

- OK on first landing. Floated past on second. 

- Satisfactory. 

- Good . 

- Tried to be extra aggressive on second approach. 

- Takeoff appeared to be most difficult. 


• ADDITIONAL FACTORS: 


• SUMMARY: SP comment: Saw PIO on second landing and take off. 
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• INITIAL REMARKS: Dangerous airplane. 


• FEEL SYSTEM CHARACTERISTICS: Forces high. Lots of displacement. Sensitivity 

very low, poor. 

• PITCH ATTITUDE CONTROL: 

- Initial Response? - Some response, no delays, but very sluggish. 

- Final Response? 

- Predictability? - Some predictability but airplane too sluggish. 


• PILOT-IN-THE-LOOP: 

- PIO Tendency? - Yes, if abrupt maneuvers or tight control attempted. 

- Piloting Techniques? - Keep gain down. Set up airplane before flare. 

- Small vs. Large Inputs? - No differences. 

- Open vs. Closed-Loop Control? 


• TASK PERFORMANCE: 

- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

e ADDITIONAL FACTORS: 


- Too fast because of pitch response. 

- Easy to overshoot although managed to land 
within limits. 

- OK. 


- Satisfactory. 

- Low, did not want to be aggressive. Tried to 
get things under control. 


- Had troubles trimming the airplane on approach. 


e SIM4ARY: 
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• INITIAL REMARKS: Made three approaches. Great apprehension about airplane. 


• FEEL SYSTEM CHARACTERISTICS: Seemed to be a deadband. Displacements large 

and sensitivity low. 


• PITCH ATTITUDE CONTROL. 

- Initial Response? 

- Final Respon se? 

- Predictability? 


- Very sluggish. 

- Not predictable due to initial response. 

- Could get to 20' and then sluggish initial 
response degrades all predictability. 


• PILOT-IN-THE-LOOP: 

- PIO Tendency? - No PIO in terms of regular oscillations, 

rather unlesirable motions. 

- Piloting Techniques? - Backed away from task, did not want to fight it. 

- Small vs. Large Inputs? - Feared large inputs. 

- Open vs. Closed-Loop Control? - Opened loop often. Did not want to use 

closed loop- type control near ground. 


• TASK PERFORMANCE: 


- Airspeed Control 

- Touchdown Point Accuracy 

- Sink Rate at Touchdown 

- Runway Alignment 

- Aggressiveness 

- Task Differences 

• ADDITIONAL FACTORS: 

• SUMMARY: 


- Poor. 

- Not within limits. Consistently overshot. 

- Not good control. 

- Reasonable. 

- Afraid to be aggressive down low. 

- Landing most difficult. Take off ragged. 
Approach no problem. 

- Got into lateral PIO r . first approach while 
using enormous pitch inputs. No problem 
after that. 


1-42 






















FLIGHT NO-EVAL 

7 CS DYN 

AMICS 

1 PIOS CONFIGURATION 

CONFIGURATION 

2695-4 

r £> 

V 

SLOPE 

BREAK PT. 

FI (A-6) 


2.0 

-1.0 

0.0 

EVAL. PILOT 

WIND/X-WIND 

TURBULENCE 

rrr 

SPR 

PIOR 

B 

08/03 

None 

10 

10 

5 


• INITIAL REMARKS: Waved off both landings; inadvertently touched down in 

middle of PIO on second approach. 

• FEEL SYSTEM CHARACTERISTICS: 


• PITCH ATTITUDE CONTROL: 

- Initial Response? 

- Final Response? 

- Predictability? 


- Sluggish. 

- Overshoots, very low frequency PIO. 

- None. 


• PILOT-IN-THE-LOOP: 

- PIO Tendency? - Constant amplitude oscillations on verge of 

being divergent. 

- Piloting Techniques? - Tried to use small inputs without success. 

- Small vs. Large Inputs? - Small inputs gradually got large. 


- Open vs. Closed-Loop Control? 


• TASK PERFORMANCE: 


- Frequency of oscillation so low that not 
confident to abandon control loop and 
come back to it. 


- Airspeed Control - OK. 

- Touchdown Point Accuracy * Not achievable. 

- Sink Rate at Touchdown 


- Runway Alignment 
• Aggressiveness 

- Task Differences 


e ADDITIONAL FACTORS: 

j 

e SUMARY: ■ 
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Appendix II 

TASK PERFORMANCE RECORDS 


Thu following time histories provide records of task performance 
for several of the evaluations. Five parameters are pic .ted in each time 
history: aircraft pitch attitude (0), aircraft pitch rate (q), stick posi- 
tion (6 ), the output of the PIOS filter (5 ) , and the PIOS filter, gain 

68 68 ^ 

attenuation factor ( XK ). The aircraft pitch attitude and pitch rate were 
recorded at positions near the aircraft's center of gravity. To extrapolate 
these values to the aircraft's precise center of gravity or pilot location re- 
quires information on the NT-33 ‘s dimensional characteristics. This infor- 
mation is contained in Reference 4. 

The plots are scaled such that 10 millemeters on the time axis is 
equal to 2 seconds. Approximately 30 seconds of record, starting at the pi- 
lot's initiation of runway alignment, are shown for each approach. A triangu- 
lar symbol 00 is placed at the lower edge of the pitch rate time history to sig- 
nify main gear touchdown. If no symbol is presented, touchdown was not made be- 
cause the pilot initiated go-around. 

The title for each tiire history identifies the configuration, flight 

number, evaluation pilot, and approach number. The same procedure was used 

on all evaluations; consequently, the first approach included a small lateral 

sidestep maneuver fc.fore touchdown and the second approach, or third if flown, 

involved a large lateral offset correction prior to landing. The time history 

parameters are defined in the units: 6 (degrees), q (degrees/second) , and i , 

68 

(inches). 
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Figure 1 1-8: CONFIGURATION T2 (A-l) PILOT B/2695 2nd LANDING OF 2 
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Figure II-9: CONFIGURATION T2 (A-l) PILOT A/2696 2nd LANDING OF 2 
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Figure II- 11: CONFIGURATION T2 (A-2) PILOT A/2692-5 2nd LANDING OF 2 
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Figure 11-12: CONFIGURATION T2 (A-2) PILOT B/2695-3 1st UNDING OF 2 
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Figure 11-13: CONFIGURATION T2 (A-?) PILOT B/2695-5 3rd LANDING OF 3 
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Figure II- 14: 


CONFIGURATION. T2 (A-6) PILOT *'2692 2nd LANDING OF 2 
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Figure 11-15: CONFIGURATION I > (B-2) PILOT A/2692 2nd LANDING OF 2 
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Figure 11-16: CONFIGURATION T2 (B-4) PILOT B/2691 1st LANDING OF 2 
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Figure 11-18: CONFIGURATION T2 (C-5) PILOT A/2693 1st LANDING OF 2 
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Figure 11-19: CONFIGURATION T2 (D-8) PILOT B/2694 2nd LANDING OF 2 
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Figure 11-20: CONFIGURATION T2 (E-7) PILOT A/2696 2nd LANDING OF 2 
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Figure 11-21: CONFIGURATION T2 (E-8) PILOT A/2693 1st LANDING OF 2 
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Figure 11-23: CONFIGURATION FI PILOT C/2697 2nd LANDING OF 2 
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Figure 11-24; CONFIGURATION FI (A-l) PILOT C/2697 1st LANDING OF 2 
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Figure 11-25: CONFIGURATION FI (A-2) PILOT C/2697 2nJ LANDING OF 2 
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Figure 11-26: CONFIGURATION FI (A-6) PILOT B/2695 1st LANDING OF 2 
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Appendix III 

SIMULATION MECHANIZATION 

This in-flight experiment was performed in the three-axis variable 
stability NT-33 aircraft, modified and operated by Calspan for the USAF, This 
appendix describes the simulation mechanization in some detail; whereas, the 
reader is referred to Reference S for complete documentation of the simula- 
tion mechanization and operation of the NT-33A aircraft. 

The aircraft dynamic characteristics for the simulated aircraft con- 
figuration were achieved by using the variable stability, response feedback 
system in the NT-33A. The configuration dynamics were implemented by feeding 
back the appropriate signals to the NT-33 control surface actuators with the 
proper feedback gains (Figure III— 1) • Closure of the feedback loops will cause 
the actuator roots to migrate somewhat, but br^ause these roots are at very 
high frequency, this movement is not of consequence and the actuator roots are 
assumed constant. The effects of the filters and sensors in the feedback paths 
cn the simulation are also considered minimal. 

The longitudinal augmented aircraft dynamics were achieved by feeding 
back angle of attack and pitch rate. The proper feedback gains were deter- 
mined during the calibration flying through data reduction using standard flight 
test techniques (Reference 10) and a digital onboard recorder. Since the gross 
weight of the NT-33 changes as fuel is depleted, the approach airspeed was 5 ched~ 
uled as a function of fuel remaining. This procedure maintains a fixed ap- 
proach angle of attack and the configuration dynamics remain approximately con- 
stant for the flight. The given values of augmented aircraft dynamics for a 
nominal approach speed of 135 KIAo are very representative, although some varia- 
tion of the dynamics still occurs due to slight changes in pitch inertia. 

On the other hand, the large contribution that tip tank fuel makes 
in the roll and yaw inertia requires that the lateral gains be scheduled to 
obtain constant configuration dynamics. Standard in-flight data reduction 
techniques were again used to determine the proper feedback gains. By sched- 
uling these as a function of fuel remaining, approximately constant 
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lateral-directional configuration characteristics were maintained (Appendix IV) 


A position command control system was used in the three control axis 
with the feel system characteristics of each held fixed. The feel system 
dynamics were mechanized using an electrohydraulic servo with position and rate 
feedbacks to control the frequency and damping as well as the desired spring 
torce gradient. Although available, no friction or breakout forces were in- 
cluded in the simulation. A digitally implemented deadband was, however, added 
to the pitch control system. 

The desired control system dynamics were simulated by altering the 
NT-33A "fly-by-wire" control system with suitable electronic circuits. The 
two radian per second, first-order prefilter for Configuration FI was imple- 
mented by the proper analog circuits. Its introduction to the pitch control 
system was selectable by a switch in the rear, safety pilot cockpit. No addi- 
tional control system dynamics were added to either the roll or yaw channels 
for this program. 

A digital time delay was added to the pitch control system to imple- 
ment configurations Tl, T2, and T3. Although values of transport, time delay 
(<■ r /*l have been -pecified according to each configuration identifier, a precise 
definition of the ttme delay network is presented to allow correct interpretation 
of its effects and avoid confusion over semantics (e.g. "equivalent" vs. "pure" 
time delay 1 . 

The time delay circuit of the NT-33A is, by itself, a pure time delay 
which merely "holds" the input signal a finite period of time before it is 
output. This circuit is a digital system producing a pure time delay which 
does mt affect the amplitude content of the signal in any way. However, this 
time delay circuit is surrounded by two low-pass analog filters in the fly-by- 
wire NT-33A control system for the suppression of noise and signal smoothing. 

The two analog filters are third-order Butterwcrth filters with break frequen- 
cies of SO cycles per second and 50 radians per second for the input and output 
filters, respectively (Figure III-2). 


1 1 1—3 


IN 



TIME DELAY 
NETWORK 


INPUT FILTER: 


1 



2 ( 0 . 5 ) 
314 



OUTPUT FILTER: 



Figure 1 1 1 -2 . NT-33A TIME DELAY NETWORK 


1 1 1 -4 




The effect of the analog filters on longitudinal flying qualities can 
be approximated as a time delay by using an equivalent systems method such as 
described in P-^erences 8 and 9, since the dynamics of the filters are of rela- 
tively high frequency. By this technique, the filters are shown to contribute 
a constant value of 45 msec equivalent time delay. 

The table below summarizes the pure delay (e T ^ S ) and equivalent time 
delay due to the time delay circuit for a given configuration identifier; remem- 
bering, of course, that associated with the pure time delay are two analog fil- 
ters which together produce the "total" time delay. 


Configuration Identifier 

Pure Digital Delay 

Equivalent Delay 


(msec) 

(msec) 

T1 

70 

115 

T2 

120 

165 

T3 

160 

205 


Pure time delay with appropriate "warnings" that the analog filters 
are also included with this delay has been used throughout this report so that 
changes from one configuration to another are described exactly. It is impor- 
tant to note that the values of time delay described are the amount of delay 
added to the flight control system. Additional analysis is required to deter- 
mine the "total" equivalent time delay of the experiment flight control system. 

A digital computer was placed in the pitch control system for imple- 
mentation of the PIOS filters and mechanization of the nominal nonlinear gradient 
for evaluations without PIOS filtering. The digital computer is part of the 
overall NT-33/Display Evaluation Flight Test (DEFT) system (Reference 11) and 
is now integrated into the NT-33 VSS for digital flight control applications. 

For this program, the digital computer was not used to close any feedback loops. 

The digital computational capability is centered around a ROLM 1602A 
general purpose digital computer. It consists of a 5 MHz microprogrammed cen* 
tral processing unit with 32K of memory (expandable to 64K), direct memory 
access, expanded instruction set, real time clock, power monitor with automatic 
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restart, and floating point firmware, as well as all the necessary input/output, 
control, and storage devices. The computer was interfaced through the Mode 
Control Unit in the safety pilot cockpit. The pilot selected an "experiment" 
which corresponded to a PIOS filter configuration depending upon the program 
tape that was loaded into the computer memory. The experiment number was 
recorded on the digital flight recorder for confirmation of the simulated 
PIOS configuration. In addition, the input to the PIOS filter (6 ), PIOS 

filter output (6 ), and gain attenuation factor (XK) were also recorded. 

68 o 

Modified z-transformations were used to digitize the position PIOS 
filter. No transformations were required to implement the rate PIOS filter. 

Note that the computer update rate for this program was an essentially con- 
stant SO cps. The effects of different update rates should be referenced 
when comparing the results of this experiment to others. 

Aside from checking the transformation and computer equations, the 
mechanization of each PIOS filter was verified by comparing time responses of 
the filters. The time history comparisons included step and sine wave re- 
sponses at numerous frequencies and amplitudes. A wide range of inputs were 
examined because of the nonlinear nature of the filters. Data on the PIOS 
filter mechanization in the NT-33 was produced by feeding the appropriate 
electrical signals as inputs to the onboard computer. This data was then 
compared with generated data for the same input. Static measures were also 
checked where possible. The comparison of the NT-33 mechanization and the 
known filter responses were, for all practical purposes, exact. 
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Appendix IV 

LATERAL-DIRECTIONAL CHARACTERISTICS 


Since this program was an investigation of longitudinal fighter fly- 
ing qualities, the lateral-directional characteristics of the NT-33A were 
tailored to produce unobtrusive. Level 1 flying qualities. Fortunately, a 
wealth of data on lateral flying qualities using the NT-33 aircraft was avail- 
able from a recently completely investigation of higher order system effects 
(Reference 3). From this program, it was a relatively straightforward process 
to choose good lateral flying qualities. The calibration and identification 
of the lateral configuration dynamics is thoroughly documented in Reference 3 
and not repeated here for that reason. This appendix briefly summarizes the 
lateral-directional characteristics simulated. (The lateral configuration 
dynamics are identical to configuration L2-1 from Reference 3 except the lat- 
eral command gain was increased by 50%). 

The modal characteristics of the simulated lateral-directional con- 
figuration are tabulated in Table IV-1. A position command yaw and roll con- 
trol system were mechanized with linear command gradients. 

For this experiment, a standard center stick and i-udder pedal ar- 
rangement was used for aircraft roll and yaw control. The physical dimensions 
of these controllers are illustrated in Figure IV-1. A simulated linear 
spring force gradient was mechanized in the center stick and rudder pedal feel 
systems and held constant throughout the program. The values were chosen to 
approximate closely the spring force gradients of other high performance 
fighter aircraft, but more importantly, the stick force per deflection grad- 
ients were tailored to levels which were not objectionable to the evaluation 
pilots. Although available, essentially no friction or breakout forces were 
included in either controller. 

The lateral center stick feel system characteristics were held fixed 
for all configurations. The lateral feel system dynamics were selected to be 
sufficiently fast and not a factor in the experiment. 
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TABLE IV- 1 


SIMULATED LATERAL-DIRECTIONAL 
MODAL CHARACTERISTICS 
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AILERON STICK 
DIMENSIONS AND 
TRAVEL: 



AILERON 

PIVOT 

POINT 



RUDDER PEDAL 
DIMENSIONS 
AND TRAVEL: 



Figure IV-1. AILERON STICK AND RUDDER PEDAL GEOMETRIES 
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The lateral feel system characteristics were approximately: 



(±_\ . 2 ( 0 . 7 ± 

\ 25/ 25 


s+1 


( in/lb) 


with the aileron actuator transfer function described by a second order system 
possessing the characteristics: 


= 60 rad/ sea 

C - 0.7 

a 

For this flight phase category C task, the rudder pedal feel system was mechan- 
ized as: 



0. 0125 

/Sx 2 2 ( 0 . 6 ) 

ho) 30 


s+1 


( in/lb) 


The rudder actuator is described as a second order system possessing 
the characteristics: 


to * 60 rad/sea 

0.7 

Signals to both the aileron and rudder actuators are passed through 
a first-order lag prefilter with a break frequency of 200 radians per sec. 
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